Code

free orig parameters after sharding#988

Code

Merged

t-vi merged 8 commits intomainLightning-AI/lightning-thunder:mainfrom tom/fsdp-composable-step2Lightning-AI/lightning-thunder:tom/fsdp-composable-step2Copy head branch name to clipboardAug 19, 2024

+39

Commits

Commits on Aug 18, 2024

• Move FSDP module transformation to transform_module

  t-vi

  committed
  b4a04c0

  Copy full SHA for b4a04c0

• import _materialize

  t-vi

  committed
  597ece2

  Copy full SHA for 597ece2

• Update thunder/distributed/transforms/fsdp_v2.py

  t-vi

  authored
  5da2880

  Copy full SHA for 5da2880

• Update thunder/distributed/transforms/fsdp_v2.py

  Show description for 96d026e
  

  t-vi

  and

  crcrpar

  authored
  96d026e

  Copy full SHA for 96d026e

Commits on Aug 19, 2024

• Merge remote-tracking branch 'origin/main' into tom/fsdp-composable-step1

  t-vi

  committed
  98f4692

  Copy full SHA for 98f4692

• free orig parameters after sharding

  t-vi

  committed
  f05768e

  Copy full SHA for f05768e

• Update thunder/distributed/transforms/fsdp_v2.py

  t-vi

  committed
  2357aad

  Copy full SHA for 2357aad

• Merge branch 'main' into tom/fsdp-composable-step2

  t-vi

  authored
  1117b3a

  Copy full SHA for 1117b3a