Correctly get parameters with unsharded grads and parameters to register sharded and sync'ed grads #1643
Azure Pipelines / lightning-thunder (GPUs) (testing ubuntu22.04 | cuda 12.1 | python 3.10 | torch 2.5.1 | grads)
succeeded
Jan 14, 2025 in 15m 34s
testing ubuntu22.04 | cuda 12.1 | python 3.10 | torch 2.5.1 | grads succeeded
Loading