Skip to content

Correctly get parameters with unsharded grads and parameters to register sharded and sync'ed grads #1643

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Jan 14, 2025

correctly get parameters

f8fbf6c
Select commit
Loading
Failed to load commit list.
Merged

Correctly get parameters with unsharded grads and parameters to register sharded and sync'ed grads #1643

correctly get parameters
f8fbf6c
Select commit
Loading
Failed to load commit list.
Azure Pipelines / lightning-thunder (GPUs) (testing ubuntu22.04 | cuda 12.1 | python 3.10 | torch 2.5.1 | distributed) failed Jan 14, 2025 in 16m 27s

testing ubuntu22.04 | cuda 12.1 | python 3.10 | torch 2.5.1 | distributed failed

1 errors / 0 warnings

Annotations

Check failure on line 506 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / lightning-thunder (GPUs) (testing ubuntu22.04 | cuda 12.1 | python 3.10 | torch 2.5.1 | distributed)

Build log #L506 

Bash exited with code '1'.
View more details on Azure Pipelines