Support the parallel conversion from ZeRO checkpoints to FP32/FP16/BF16 param weight #6655

xylian86 wants to merge 11 commits intodeepspeedai:masterdeepspeedai/DeepSpeed:masterfrom

xylian86:parallel_zero_to_fp32_conversionxylian86/DeepSpeed:parallel_zero_to_fp32_conversionCopy head branch name to clipboard