Code

feat: Spellcheck#345

Code

Merged

raphael0202 merged 44 commits intodevelopopenfoodfacts/openfoodfacts-ai:developfrom spellcheckopenfoodfacts/openfoodfacts-ai:spellcheckCopy head branch name to clipboardAug 23, 2024

+5,070-1,471

Commits

Commits on Jun 18, 2024

• feat(spellcheck): ⚡ Add feature: push to Argilla from an HF dataset

  jeremyarancio

  committed
  4ad41de

  Copy full SHA for 4ad41de

• fix(spellcheck): 🐛 Add fixes to T5 script

  jeremyarancio

  committed
  128e056

  Copy full SHA for 128e056

• fix(spellcheck): 🐛 Add guardrail to prevent compiuting metrics with empty strings

  jeremyarancio

  committed
  3217a89

  Copy full SHA for 3217a89

• feat(spellcheck): 🎨 Training pipeline using Metaflow

  jeremyarancio

  committed
  8bd97f2

  Copy full SHA for 8bd97f2

• feat(spellcheck): 🎨 LLM QLoRA TRL training script - Mistral - 7B - Instruct

  jeremyarancio

  committed
  a858bc8

  Copy full SHA for a858bc8

Commits on Jun 19, 2024

• perf(spellcheck): 🧪 Normalize evaluation algorithm

  Show description for 634b050
  jeremyarancio

  committed
  634b050

  Copy full SHA for 634b050

Commits on Jun 20, 2024

• feat(spellcheck): 🎨 Implement LLM training with Sagemaker & Metaflow

  Show description for e16c6a2
  jeremyarancio

  committed
  e16c6a2

  Copy full SHA for e16c6a2

• feat(spellcheck): ⚡ Mistral 7b instruct v3 trained

  jeremyarancio

  committed
  2f6f75b

  Copy full SHA for 2f6f75b

Commits on Jun 25, 2024

• feat(spellcheck): 🎨 Update guidelines: accents

  jeremyarancio

  committed
  db2780c

  Copy full SHA for db2780c

• refactor(spellcheck): ✨ Update Logging to consider script and src code for defining the level

  jeremyarancio

  committed
  a6bc377

  Copy full SHA for a6bc377

• feat(spellcheck): ✨ Dataset processing methods & pipeline created

  jeremyarancio

  committed
  94b17d7

  Copy full SHA for 94b17d7

Commits on Jun 27, 2024

• build(spellcheck): ✨ Dataset processing (oe, percentage alignment): v3.1

  jeremyarancio

  committed
  8a3e9eb

  Copy full SHA for 8a3e9eb

Commits on Jun 28, 2024

• feat(spellcheck): ♻️ Training Mistral-7B-Instruct: instruction + unidecode normalization + scheduler linear

  jeremyarancio

  committed
  fd0460b

  Copy full SHA for fd0460b

• Delete previous training lllm dag

  jeremyarancio

  committed
  1559740

  Copy full SHA for 1559740

Commits on Jul 1, 2024

• feat(spellcheck): ⚡ Add eval normalization: remove "\n"

  jeremyarancio

  committed
  a612752

  Copy full SHA for a612752

• refactor(spellcheck): 👷 Foundational LLMs re-evaluated on the benchmark

  Show description for cb393c6
  jeremyarancio

  committed
  cb393c6

  Copy full SHA for cb393c6

• Modify overfitted prompt

  jeremyarancio

  committed
  edce9c5

  Copy full SHA for edce9c5

Commits on Jul 8, 2024

• Merge branch 'develop' into spellcheck

  jeremyarancio

  committed
  1645a83

  Copy full SHA for 1645a83

• refactor(spellcheck): 🏷️ Refactor Argilla extraction: modules + unitests + dag

  jeremyarancio

  committed
  6170159

  Copy full SHA for 6170159

• refactor(spellcheck): ⬆️ Refactor training job: add parameters to argparse + add cometML logs

  jeremyarancio

  committed
  d2f63c7

  Copy full SHA for d2f63c7

Commits on Jul 9, 2024

• feat(spellcheck): 🎨 Fine-tune Mistral-7b with guidelines + training scripts improvments

  jeremyarancio

  committed
  b9c1dc2

  Copy full SHA for b9c1dc2

• feat(spellcheck): ✨ Add args for training + Train Mistral-7b-base

  jeremyarancio

  committed
  6ddf189

  Copy full SHA for 6ddf189

Commits on Jul 10, 2024

• fix(spellcheck): 🐛 Correction error in Mistral-7B-Base fine-tuning script

  jeremyarancio

  committed
  33e9691

  Copy full SHA for 33e9691

Commits on Jul 15, 2024

• feat(spellcheck): 🎨 DPO dataset extraction and push

  jeremyarancio

  committed
  a3d310d

  Copy full SHA for a3d310d

Commits on Jul 17, 2024

• fix(spellcheck): 🔖 small fixes

  jeremyarancio

  committed
  fea5716

  Copy full SHA for fea5716

• feat(spellcheck): ⚡ DPO training script

  jeremyarancio

  committed
  7092b69

  Copy full SHA for 7092b69

• refactor(spellcheck): 🚧 Refactor training pipeline: WIP

  jeremyarancio

  committed
  7448e10

  Copy full SHA for 7448e10

Commits on Jul 18, 2024

• Update get_logger for Metaflow logging

  jeremyarancio

  committed
  cdcc825

  Copy full SHA for cdcc825

• feat(spellcheck): ✨ Double the benchmark size: extraction and push to Argilla pipeline (WIP)

  jeremyarancio

  committed
  7cf82a9

  Copy full SHA for 7cf82a9

Commits on Jul 21, 2024

• docs(spellcheck): 📝 Document benchmark generation pipeline

  jeremyarancio

  committed
  e28a470

  Copy full SHA for e28a470

• feat(spellcheck): 🐛 Remove legacy metadata in Argilla

  jeremyarancio

  committed
  b6b5bf8

  Copy full SHA for b6b5bf8

Commits on Jul 22, 2024

• refactor(spellcheck): 🚧 Refactor training pipeline (WIP)

  jeremyarancio

  committed
  a4f295a

  Copy full SHA for a4f295a

Commits on Jul 23, 2024

• refactor(spellcheck): 🚧 Refactor training script (WIP)

  jeremyarancio

  committed
  c6aaee5

  Copy full SHA for c6aaee5

• refactor(spellcheck): 🚧 Refactor training pipeline

  jeremyarancio

  committed
  4401966

  Copy full SHA for 4401966

• chore(spellcheck): ✨ Update Python from 3.9 to 3.10

  jeremyarancio

  committed
  e870a24

  Copy full SHA for e870a24

Commits on Jul 24, 2024

• refactor(spellcheck): ⚡ LLM training pipeline refactored

  jeremyarancio

  committed
  08a097a

  Copy full SHA for 08a097a

Commits on Jul 25, 2024

• feat(spellcheck): ✨ Pretraining before fine-tuning (WIP)

  jeremyarancio

  committed
  b563be1

  Copy full SHA for b563be1

• feat(spellcheck): 🚑 Pretraining + Finetuning Mistral-7B

  jeremyarancio

  committed
  f0d924d

  Copy full SHA for f0d924d

Commits on Jul 28, 2024

• refactor(spellcheck): ✨ Refactor training

  jeremyarancio

  committed
  ac4f496

  Copy full SHA for ac4f496

Commits on Aug 5, 2024

• feat(spellcheck): 🚧 Batch processing (WIP)

  jeremyarancio

  committed
  1600a65

  Copy full SHA for 1600a65

Commits on Aug 14, 2024

• feat(spellcheck): 🚧 Batch job with vllm and GCP (WIP)

  jeremyarancio

  committed
  f28dbc5

  Copy full SHA for f28dbc5

Commits on Aug 15, 2024

• feat(spellcheck): ⚡ Batch job operational on GCP

  jeremyarancio

  committed
  c7b0709

  Copy full SHA for c7b0709

Commits on Aug 16, 2024

• refactor(spellcheck): ✨ Clean code and add logging to batch job

  jeremyarancio

  committed
  0ef32f8

  Copy full SHA for 0ef32f8

• fix(spellcheck): 📦 Forgot to add batch dep requirements

  jeremyarancio

  committed
  70a33e1

  Copy full SHA for 70a33e1