What type of GPU/CPU is used for indexing? #160
-
|
Hi, I'm checking my system while Smart2Brain is indexing but I don't see any movement in the NVIDIA GPU performance. But I see like 1/3 of my i7 CPU working. Is that because indexing is done through regular CPU? |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
|
I also noted that when asking a query, GPU doesn't get workload... Is there anything needed to configure so it uses the GPU? |
Beta Was this translation helpful? Give feedback.
I also noted that when asking a query, GPU doesn't get workload... Is there anything needed to configure so it uses the GPU?
I changed the model used to llama2 and now the GPU gets workload.
So I believe Ollama switches to regular CPU when the model is too big to be handled by the memory card.
Thanks!