Dockerized FastAPI wrapper for Kokoro-82M text-to-speech model w/CPU ONNX and NVIDIA GPU PyTorch support, handling, and auto-stitching

Visual inference exploration & experimentation playground

ThunderAI is a Thunderbird Addon that uses the capabilities of ChatGPT, Gemini or Ollama to enhance email management.

LM inference server implementation based on *.cpp.

A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.

An OpenAI Compatible API which integrates LLM, Embedding and Reranker. 一个集成 LLM、Embedding 和 Reranker 的 OpenAI 兼容 API

C# client for KoboldCpp.

Unified C# client for LLM providers.

A FastAPI-powered REST API offering a comprehensive suite of natural language processing services using machine learning models with PyTorch and Transformers, packaged in a Docker container to run efficiently.

GitHub Copilot API wrapper to make it OpenAI compatible

C# client for LM Studio.

Achieve search sovereignty with Toledo1, a compound LLM browser

Demonstrates that Spring AI can be configured to work with OpenRouter so that you can work with multiple LLMs through a single Open AI compatible interface. Potentially helpful when evaluating the performance and quality of model responses.

LLM based assistant running as a Telegram Bot.

C# client for Oobabooga.

A Discordjs bot that uses OpenAI compatible endpoints for chatting.