Skip to content

Commit

Permalink
fix 10B
Browse files Browse the repository at this point in the history
  • Loading branch information
@samsja
samsja committed Oct 8, 2024
1 parent a0c42e0 commit 1347c4c
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion configs/10B/H100.toml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@ name_model = "10B"
project = "debug_10B_zero_band"

[train]
micro_bs = 2
micro_bs = 1
ac_ckpt = true

[optim]
Expand Down

0 comments on commit 1347c4c

Please sign in to comment.