feat: Add support for DPO#556

Open

sandeepchittilla wants to merge 11 commits intoCarperAI:mainfrom

sandeepchittilla:504-dpo-trainer

Commits on Sep 12, 2023

Initial commit DPO support
sandeepchittilla
committed
Add default config for DPO and trainer functionality
sandeepchittilla
committed
Add DPO training example and fix minor bugs
sandeepchittilla
committed

Commits on Sep 13, 2023

Update .gitignore and minor refactor
sandeepchittilla
committed
Add type hinting and minor refactor
sandeepchittilla
committed

Commits on Sep 14, 2023

Update docstrings
sandeepchittilla
committed

Commits on Sep 27, 2023

Add Deepspeed init support when using stage 3
sandeepchittilla
committed

Commits on Nov 14, 2023

Add dpo example
sandeepchittilla
committed

Commits on Nov 15, 2023

Update hyperparementers
sandeepchittilla
committed

Commits on Nov 20, 2023

Fix prompt truncation bug and handle deepspeed preparation
sandeepchittilla
committed

Commits on Nov 23, 2023

Use slower training parameters
sandeepchittilla
committed