CPU Port

[okpatil4u]

How can I port these models to a CPU only code ? I have 128 GB Mac M1 Ultra Studio system which has 21 Tflops throughput, which render the use of block fftconv moot.

Is it possible to create a CPU only model ? How should one start working on it ?

[DanFu09]

This is on our roadmap - there's some dependencies that we need to work through for the SSM support (just kernel generation, not even the block FFTConv yet).

Thank you for posting the issue! It's helpful to get a sense of the platforms that people want to run on.

[okpatil4u]

Thanks Dan. After the changes in your roadmap, can we benchmark the huggingface weights on CPU then ?

[DanFu09]

We’ll be sure that it works!

…

On Wed, Jan 25, 2023 at 1:34 AM Omkar Patil ***@***.***> wrote: Thanks Dan. After the changes in your roadmap, can we benchmark the huggingface weights on CPU then ? — Reply to this email directly, view it on GitHub <#7 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ABDDIIUN6LKV3QS2SQPW5UTWUDXRNANCNFSM6AAAAAAUGBRICE> . You are receiving this because you commented.Message ID: ***@***.***>

[okpatil4u]

Hey Dan, do you have any timelines in mind for this ?