Zero-Offload + Pytorch Compile 2.0 + ONNXRT

[agemagician]

Hello,

Are there any plans to support CPU offload + pytorch compile using onnxrt backend ?

I need to accelerate bloom 176B model using only 2 GPUs but it seems a bit slow.