Skip to content

Commit

Permalink
Add github action workflow to optimize building validation thresholds
Browse files Browse the repository at this point in the history
  • Loading branch information
leavauchier committed Apr 29, 2024
1 parent da34adc commit 28877f9
Showing 1 changed file with 80 additions and 0 deletions.
80 changes: 80 additions & 0 deletions .github/workflows/building_validation_thresholds_optimization.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,80 @@
# Workflow name
name: "Building validation thresholds optimization"

on:
# Run workflow on user request
workflow_dispatch:
inputs:
sampling_name:
description: |
Sampling name :
Nom du dataset sur lequel le modèle a été entraîné.
Utilisé pour générer un chemin standard pour les entrées et sorties dans le
dossier IA du store (projet-LHD/IA/LIDAR-PROD-OPTIMIZATION/$SAMPLING_NAME/$MODEL_ID)
Eg. YYYYMMDD_MonBeauDataset
required: true
model_id:
description: |
Identifiant du modèle :
Utilisé pour générer un chemin standard pour les entrées et sorties dans le
dossier IA du store (projet-LHD/IA/LIDAR-PROD-OPTIMIZATION/$SAMPLING_NAME/$MODEL_ID)
Exemple : YYYMMDD_MonBeauSampling_epochXXX_Myria3Dx.y.z
required: true

jobs:
optimize-building-validation-thresholds:
runs-on: self-hosted
env:
WORKDIR: /var/data/LIDAR-PROD-OPTIMIZATION/
IO_DIR: /var/data/LIDAR-PROD-OPTIMIZATION/${{ github.event.inputs.sampling_name }}/${{ github.event.inputs.model_id }}/
DATA: /var/data/LIDAR-PROD-OPTIMIZATION/20221018_lidar-prod-optimization-on-151-proto/Comparison/
THRESHOLDS_FILE: valset-opti-results/optimized_thresholds.yaml
OUTPUT_CONFIG_FILE: LIDAR-PROD-${{ github.event.inputs.model_id }}.yaml
nexus_server: docker-registry.ign.fr

steps:
- name: Log configuration
run: |
echo "Optimize building validation threshold for a given trained model"
echo "Model ID ${{ github.event.inputs.model_id }}"
echo "input/output dir: ${{env.IO_DIR}}"
echo "data: ${{env.DATA}}"
echo "validation input_las_dir: ${{env.IO_DIR}}/preds-valset/"
echo "test input_las_dir: ${{env.IO_DIR}}/preds-testset/"
echo "output thresholds file: ${{env.IO_DIR}}/${{env.THRESHOLDS_FILE}}"
echo "output config file: ${{env.IO_DIR}}/${{env.OUTPUT_CONFIG_FILE}}"
- name: Checkout branch
uses: actions/checkout@v4

# get version number, to retrieve the docker image corresponding to the current version
- name: Get version number
run: |
echo "VERSION=$(docker run lidar_prod python -m lidar_prod.version)" >> $GITHUB_ENV
- name: pull docker image tagged with current version
run: |
docker pull ${{ env.nexus_server }}/lidar_hd/lidar_prod:${{ env.VERSION }}
- name: Optimization and evaluation on validation dataset
run: >
docker run --network host
${{ env.nexus_server }}/lidar_hd/lidar_prod:${{ env.VERSION }}
python lidar_prod/run.py
++task=optimize_building
building_validation.optimization.todo='prepare+optimize+evaluate+update'
building_validation.optimization.paths.input_las_dir=${{env.IO_DIR}}/preds-valset/
building_validation.optimization.paths.results_output_dir=${{env.IO_DIR}}/valset-opti-results/
building_validation.optimization.paths.output_optimized_config=${{env.IO_DIR}}/${{env.OUTPUT_CONFIG_FILE}}
hydra.run.dir=${{env.IO_DIR}}/valset-opti-results/
- name: Evaluation on test dataset
run: >
docker run --network=host
${{ env.nexus_server }}/lidar_hd/lidar_prod:${{ env.VERSION }}
python lidar_prod/run.py
building_validation.optimization.todo='prepare+evaluate+update'
building_validation.optimization.paths.input_las_dir=${{env.IO_DIR}}/preds-testset/
building_validation.optimization.paths.results_output_dir=${{env.IO_DIR}}/testset-opti-results/
building_validation.optimization.paths.building_validation_thresholds=${{env.IO_DIR}}/${{env.THRESHOLDS_FILE}}
hydra.run.dir=${{env.IO_DIR}}/testset-opti-results/

0 comments on commit 28877f9

Please sign in to comment.