⚡ Python-free Rust inference server — OpenAI-API compatible. GGUF + SafeTensors, hot model swap, auto-discovery, single binary. FREE now, FREE forever.
-
Updated
Sep 24, 2025 - Rust
⚡ Python-free Rust inference server — OpenAI-API compatible. GGUF + SafeTensors, hot model swap, auto-discovery, single binary. FREE now, FREE forever.
A high-performance API server that provides OpenAI-compatible endpoints for MLX models. Developed using Python and powered by the FastAPI framework, it provides an efficient, scalable, and user-friendly solution for running MLX-based vision and language models locally with an OpenAI-compatible interface.
A high-performance, self-hosted Deno proxy that makes Fal.ai's powerful models (Flux, SDXL, etc.) compatible with the standard OpenAI image generation API. Use any OpenAI client seamlessly.
duck.ai openai compatible api server
让 GLM-4.5 完美适配 Agent TARS 系统的高性能适配器 - 解决 toolcall 兼容性,提供智能 fallback,极低成本享受顶级 AI Agent 体验
A Docker-based OpenAI-compatible Text-to-Speech API server powered by Kyutai's TTS models with GPU acceleration support.
An adapter to add OpenAI compatibility to your Hono app using the Vercel AI SDK
Spark-TTS Text-to-Speech with an OpenAI-compatible API, supporting seamless, unlimited-length generations. Includes a CLI interface.
The Universal LLM Gateway - Integrate ANY AI Model with One Consistent API
Complete guide to convert GitHub Copilot into an OpenAI-compatible API
Poe API - OpenAI Compatible Wrapper
All-in-one local AI stack for Mistral-13B and Llama.cpp, with one-step CUDA wheel install, OpenAI-compatible API, and modern web dashboard. Switch between local and cloud chat, run on your own GPU, and deploy instantly—no API keys or paywalls. Designed for easy install, custom builds, and fast remote access. Enjoy!
Local-first Copilot-style assistant powered by screen, mic, and clipboard input — fully offline, works with any LLM or OCR engine. Press a key, get results. No cloud, no lock-in.
🤖 Serverless AI on Hedera! Smart contracts run LLMs ⚙️ Distilled GGUF on IPFS. Pay crypto 🪙 → get replies 💬. 99.9% cheaper 💸 than big-tech APIs. Decentralized ⛓️ no censorship. “Gov can’t stop it. Nobody can.” 🧠 – Sir Charles Spikes , Cincinnati,Ohio| TELEGRAM: @SirGODSATANAGI✉️ SirCharlesspikes5@gmail.com #AGI #NoPC
🧠 Synapse - Supercharge your AI coding assistants with memory, context, MCP tools, and intelligent routing. Works with Cline, Roo, Cursor, and any OpenAI-compatible tool. Just change the API endpoint and get superpowers! ✨
A light-weight framework for building AI agents with Native OpenAI API compatibility
Official JavaScript/TypeScript SDK for Inferra API access
MCP Connection Hub - A unified Model Context Protocol Gateway
Add a description, image, and links to the openai-compatible topic page so that developers can more easily learn about it.
To associate your repository with the openai-compatible topic, visit your repo's landing page and select "manage topics."