fully-sharded-data-parallel

Here are 2 public repositories matching this topic...

A script for training the ConvNextV2 on CIFAR10 dataset using the FSDP technique for a distributed training scheme.

Fully Sharded Data Parallel (FSDP) implementation of Transformer XL

Add a description, image, and links to the fully-sharded-data-parallel topic page so that developers can more easily learn about it.

To associate your repository with the fully-sharded-data-parallel topic, visit your repo's landing page and select "manage topics."