Skip to content

Milestone 2

Jump to bottom
Sudip Padhye edited this page Mar 29, 2021 · 13 revisions

Project Overview

This project provides a user interface to upload photos to the archive on remote storage servers. It provides pipelines for extracting additional picture metadata using open-source image parsing libraries & Image tags using ML/DL algorithms. The application also enables browsing the photos organized into collections and metadata & tag based searches. It makes use of distributed systems architecture along with Micro-services & Micro-Frontends, and Cloud-Native Architecture principles.

Languages Used:

  1. Front-End: React.JS
  2. Back-End: Java, Python, Node.js

Dependencies

  1. Node.js and npm
  2. Java 11
  3. Eclipse
  4. Python
  5. Download Maven
    Setting up Maven Environment
  6. Kafka
  7. MySQL

Setting up the right directory

git clone git@github.com:airavata-courses/PingIntelligence.git

cd PingIntelligence/

git checkout milestone_2

Setting up each microservices and front-end

1. API Gateway

cd apigateway/

Install dependencies

npm install

Start the default node server on 3001 (node gateway.js)

npm start

2. Image upload Management

cd mainuploadmgmt/

Open this directory in the IDE. Set up the Eclipse project with the pom.xml

Update Maven project

Run as > Clean Build

Run MainuploadmgmtApplication.java file.

3. Metadata Extraction Service

cd metadata-extraction-service/

Open this directory in the IDE. Set up the Eclipse project with the pom.xml

Update Maven project

Run as > Clean Build

Run UploadingFilesApplication.java file.

4. Metadata Extractor Search

cd metadataextractorsearch/

set up virtual for django project

python -m venv venv

source venv/scripts/activate to activate the virtual environment

on Windows

.\venv\Scripts\activate

download dependencies

pip install -r requirements.txt

migrate the database with

python manage.py makemigrations

python manage.py migrate

in order to run the server

python manage.py runserver

5. User Management

cd usermgnt/

Open this directory in the IDE. Set up the Eclipse project with the pom.xml

Update Maven project

Run as > Clean Build

Run PhotosqaudusermgntApplication.java file.

6. Front-end

cd ui/

npm install

npm start

Access the UI using the address: http://localhost:3000/

7. Kafka (Message Broker)

kafka version : kafka_2.12-2.2.0

to start zookeeper : to go this path 18126@DESKTOP-2ORIMG7 MINGW64 ~/Downloads/kafka_2.12-2.2.0/bin/windows $ pwd /c/Users/18126/Downloads/kafka_2.12-2.2.0/bin/windows

then > put below script for zookeeper zookeeper-server-start.bat ../../config/zookeeper.properties

to start kafka : for kafka server go to below path : 18126@DESKTOP-2ORIMG7 MINGW64 ~/Downloads/kafka_2.12-2.2.0/bin/windows $ pwd /c/Users/18126/Downloads/kafka_2.12-2.2.0/bin/windows and write for kafka start >>>>

kafka-server-start.bat ../../config/server.properties

Create topic : topic name is "test" kafka-topics -zookeeper localhost:2181 -topic test -create

8. Upload to Google Drive

cd uploadgoogledrive/

python uploadphtotostodrive.py

Clone this wiki locally