Code

Create pretrain_starcoder2_1b.slurm#82

Code

Open

loubnabnl wants to merge 4 commits intomulti-query-attentionbigcode-project/Megatron-LM:multi-query-attentionfrom starcoder2-examplebigcode-project/Megatron-LM:starcoder2-exampleCopy head branch name to clipboard

+290

Commits

Commits on Nov 10, 2023

• Create pretrain_starcoder2_1b.slurm

  loubnabnl

  authored
  bb82121

  Copy full SHA for bb82121

• Update pretrain_starcoder2_1b.slurm

  loubnabnl

  authored
  61ff9d9

  Copy full SHA for 61ff9d9

Commits on Nov 14, 2023

• Create pretrain_starcoder2_1b_fix_rope.slurm

  loubnabnl

  authored
  aacf493

  Copy full SHA for aacf493

• Update pretrain_starcoder2_1b_fix_rope.slurm

  loubnabnl

  authored
  b13e6da

  Copy full SHA for b13e6da