Run the latest LLMs and VLMs across GPU, NPU, and CPU with PC (Python/C++) & mobile (Android & iOS) support, running quickly with OpenAI gpt-oss, Granite4, Qwen3VL, Gemma 3n and more.
An AI-powered file management tool that ensures privacy by organizing local texts, images. Using Llama3.2 3B and Llava v1.6 models with the Nexa SDK, it intuitively scans, restructures, and organizes files for quick, seamless access and easy retrieval.
[ICLR 2019] ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardware
Official PyTorch implementation of "EdgeSAM: Prompt-In-the-Loop Distillation for On-Device Deployment of SAM"
离线版设备端人脸识别 动作活体、静默活体、近红外双目活体检测 以及1:N M:N 人脸搜索算法SDK 封装；全程可开飞行模式不用联网 🧒 on_device Face Recognition 、 Liveness detection and 1:N & M:N Face Search SDK
TinyChatEngine: On-Device LLM Inference Library
On-device LLM execution in React Native with Vercel AI SDK compatibility
NativeMind: Your fully private, open-source, on-device AI assistant
[CVPR 2025] Official PyTorch implementation of "EdgeTAM: On-Device Track Anything Model"
On-device Neural Engine
Android Input Method Editor (IME) based on Whisper
[ECCV 2018] AMC: AutoML for Model Compression and Acceleration on Mobile Devices
Android Voice Activity Detection (VAD) library. Supports WebRTC VAD GMM, Silero VAD DNN, Yamnet VAD DNN models.
Local-first, open-source AI assistant for your data. Unify tasks, notes, docs, photos, and bookmarks. Private, self-hosted, and extensible via APIs.
A ready-to-use, minimal app that converts any speech into text.
The world’s #1 end-to-end job agent: semantic filters, ATS-optimized resumes, referrals from hiring managers — 100% hands-free.
AubAI brings you on-device gen-AI capabilities, including offline text generation and more, directly within your app.
电子鹦鹉 / Toy Language Model
Multi-Task Temporal Shift Attention Networks for On-Device Contactless Vitals Measurement (NeurIPS 2020)
PennyWise automatically reads transaction SMS messages and transforms them into organized financial data with on-device AI assistance. No manual entry, no cloud processing, complete privacy.
Add a description, image, and links to the on-device-ai topic page so that developers can more easily learn about it.
To associate your repository with the on-device-ai topic, visit your repo's landing page and select "manage topics."