Correctly get parameters with unsharded grads and parameters to register sharded and sync'ed grads#1643

t-vi merged 1 commit intotom/drop-old-style-distributedLightning-AI/lightning-thunder:tom/drop-old-style-distributedfrom

crpa/patch-for-fsdpv2Lightning-AI/lightning-thunder:crpa/patch-for-fsdpv2Copy head branch name to clipboard