Multi-GPU support

[beshanoe]

Due diligence

• I have done my due diligence in trying to find the answer myself.

Topic

The PyTorch implementation

Question

Is it possible to make the model run on multiple GPUs? I tried to make AI implement the solution and actually was able load it on 2 5060 ti 16gb and then to hear the model speak although with enormous lag and glitches. So in principle it should work, but maybe something will prevent it from working smoothly in such an arrangement anyway?

[chris2008-dotcom]

Yes this is my problem too. Apparently (according to ChatGPT the 5060 ti 16gb is 'too modern' for the software.

[beshanoe]

made it work https://github.com/beshanoe/personaplex