[WIP][overlap] Overlap simulation on 1d, 2d variants of llama3 for 64, 256 gpus#289
Draft
IvanKobzarev wants to merge 1 commit intomainfrom
Draft
[WIP][overlap] Overlap simulation on 1d, 2d variants of llama3 for 64, 256 gpus#289IvanKobzarev wants to merge 1 commit intomainfrom
IvanKobzarev wants to merge 1 commit intomainfrom