Collaboration and help needed for running genai models on Uno Q

[shivaylamba]

Hi @MartinsRepo can we connect, I have a UnoQ device and wanted to run some GenAI experiments on the device. is there a way to run this without using an SD card - running LLMs or even SLMs

[MartinsRepo]

Hello, yes, we can connect. The reason, why i used a sdcard was i used ollama to test out some llms. Of course, you can take eg. Qwen3:0.6b from Hugging Face https://huggingface.co/Qwen/Qwen3-0.6B-BaseIt would be interesting to use this model running in the internal ram without the limitation of USB and podman.On my Github, you find another interesting project with facedetection and interpretationhttps://github.com/MartinsRepo/FlowiseFaceMeshMy fokus is at the moment to collect data from a heart rate sensor, jsonify it and give it the llm for interpretation. I think, data interpretation by llms could be a very interesting aspect using the Arduino as an intelligent egde device or in robotic usecases.You can find me also in LinkedIn.Martin HummelOn 12/19/25, 8:04 PM Shivay Lamba ***@***.***> wrote: shivaylamba created an issue (MartinsRepo/Arduino-Uno-Q-Projects#1) Hi @MartinsRepo can we connect, I have a UnoQ device and wanted to run some GenAI experiments on the device. is there a way to run this without using an SD card - running LLMs or even SLMs —Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you were mentioned.Message ID: ***@***.***>

[shivaylamba]

Thanks @MartinsRepo I have emailed you on the mail listed on your github user profile

[MartinsRepo]

The email address is ok, can you resend it?

[MartinsRepo]

I tried it as shown with sd card - podman - ollama with a very low lateny of about 90 sec. I also tried (documented here) a face interpretation with OpenAI and Google Mediapipe. It runs very fast. Have a look.