✨ Feat: Preprocessing and augmentations with parameters #25

AI-Daita · 2022-05-22T08:53:51Z

No description provided.

Signed-off-by: Pascal Marco Caversaccio <pascal.caversaccio@hotmail.ch>

…-and-augmentations-with-params-formatting ♻️ formatting

Signed-off-by: Pascal Marco Caversaccio <pascal.caversaccio@hotmail.ch>

pcaversaccio

checking...

augmentation/augmentor.py

healthcheck/healthcheck_list.py

pcaversaccio · 2022-05-22T13:25:39Z

Will make the final review today evening / tomorrow and in case nothing major pops-up I'm gonna merge it @giaoNguyen70

…ratio

Signed-off-by: Pascal Marco Caversaccio <pascal.caversaccio@hotmail.ch>

augmentation/augmentations_list.py

preprocessing/preprocessing_utils.py

preprocessing/references.py

augmentation/augmentor.py

preprocessing/preprocessor.py

augmentation/augmentor.py

pcaversaccio · 2022-05-23T09:57:35Z

LGTM now - merging

AI-Daita added 30 commits April 21, 2022 09:31

Update

28afd36

Accept parameters when run augmentations

f185d00

Fix a bug when parameters are empty

385b67b

Increase number of replicas when deploy

52cfcb0

Accept parameters when deploy augmentations

96f6bb4

Remove healtcheck function when deploy

fddb5cb

Fix wrong dimension in NormalizeBrightness

e2b4cfc

Fix wrong dimension in NormalizeSaturation

75412bb

Fix wrong dimension in NormalizeSaturation

78b66b9

Fix wrong dimension

e382edd

Add functions to find reference images based on preprocessing method

7b1f92b

Update preprocessing with new reference images

9939c33

Reduce number of replicas when deploy

0260e15

Run preprocessing with single process

89c412d

Add debug statement in preprocessing

d3ff503

Add debug statement in augmentation

121cb41

Deploy 1 preprocessing model per core instead of using multi-processing

cdcf202

Split augmentation deployment into separate endpoint

5e265c7

Change replicas of preprocessing and augmentation

78d9f4f

Split augmentation deployment into separate endpoint

f018709

Add debug statement in augmentation

95095a4

Add debug statement in augmentation and preprocessing

e9f8a71

Add grayscale and high_resolution back to registry

825ffa7

Fix a bug when calling grayscale in preprocessing

3bbfd6a

Only keep extra dependencies in requirements-dev

721df92

Add python-dotenv to read secret

369ca06

Read aws secret from .env

bac0e67

Read aws secret from .env

0eae052

Specify absolute .env file and region name

dceb916

Specify absolute .env file and region name

674a57b

pcaversaccio and others added 4 commits May 20, 2022 15:05

♻️ formatting

ff385ea

Signed-off-by: Pascal Marco Caversaccio <pascal.caversaccio@hotmail.ch>

Merge pull request #21 from daita-technologies/feat/run-preprocessing…

cc8f337

…-and-augmentations-with-params-formatting ♻️ formatting

requirements-dev

43153a5

Signed-off-by: Pascal Marco Caversaccio <pascal.caversaccio@hotmail.ch>

Resolve conflicts

d7064d7

AI-Daita self-assigned this May 22, 2022

AI-Daita changed the title ~~Feat/run preprocessing and augmentations with params - after solving conflict~~ Feat/run preprocessing and augmentations with params into dev - after solving conflict May 22, 2022

AI-Daita requested a review from pcaversaccio May 22, 2022 08:55

pcaversaccio reviewed May 22, 2022

View reviewed changes

augmentation/augmentor.py Outdated Show resolved Hide resolved

Add debug statements in augmentation

6e55669

pcaversaccio reviewed May 22, 2022

View reviewed changes

healthcheck/healthcheck_list.py Show resolved Hide resolved

pcaversaccio added ai tools 🤖 Issues related to AI tools python 🐍 Pull requests that update Python code labels May 22, 2022

AI-Daita added 2 commits May 22, 2022 10:42

Skip running augmentations for un-supported files

e9ba3ec

Skip running preprocessing for un-supported files

7686e54

pcaversaccio mentioned this pull request May 22, 2022

Move health check calculation to ai-tools repository daita-technologies/backend#95

Open

AI-Daita and others added 3 commits May 22, 2022 15:21

Add function to find reference image for high resolution

77e0f84

Return image with max height or width if there are no desired aspect …

e586760

…ratio

🧹 fix formatting

43cecf1

Signed-off-by: Pascal Marco Caversaccio <pascal.caversaccio@hotmail.ch>

pcaversaccio reviewed May 23, 2022

View reviewed changes

preprocessing/preprocessor.py Show resolved Hide resolved

augmentation/augmentor.py Show resolved Hide resolved

pcaversaccio changed the title ~~Feat/run preprocessing and augmentations with params into dev - after solving conflict~~ ✨ Feat: Preprocessing and augmentations with parameters May 23, 2022

pcaversaccio added 3 commits May 23, 2022 11:48

removing Any

76ad7e9

removing Counter

a69d0a7

remove kornia from preprocessing_utils.py

cb0bce9

pcaversaccio mentioned this pull request May 23, 2022

Move constants to a separate file #26

Open

pcaversaccio merged commit 4579c9a into develop May 23, 2022

pcaversaccio deleted the feat/run-preprocessing-and-augmentations-with-params branch May 23, 2022 09:58

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

✨ Feat: Preprocessing and augmentations with parameters #25

✨ Feat: Preprocessing and augmentations with parameters #25

AI-Daita commented May 22, 2022

pcaversaccio left a comment •

edited

Loading

pcaversaccio commented May 22, 2022

pcaversaccio commented May 23, 2022

✨ Feat: Preprocessing and augmentations with parameters #25

✨ Feat: Preprocessing and augmentations with parameters #25

Conversation

AI-Daita commented May 22, 2022

pcaversaccio left a comment • edited Loading

Choose a reason for hiding this comment

pcaversaccio commented May 22, 2022

pcaversaccio commented May 23, 2022

pcaversaccio left a comment •

edited

Loading