A simple Python script for running LLMs on Intel's Neural Processing Units (NPUs)
ai intel inference text-generation gpt openvino npu llm mistral-7b tinyllama qwen2 llama3 microsoft-phi-3 npu-llm
-
Updated
Jan 27, 2025 - Python