Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.

WebUI for Fine-Tuning and Self-hosting of Open-Source Large Language Models for Coding

The simplest way to serve AI/ML models in production

Run AI ✨ assistant locally! with simple API for Node.js 🚀

Open-Source Implementation of WizardLM to turn documents into Q:A pairs for LLM fine-tuning

Use any LLM from the command line.

A guide about how to use GPTQ models with langchain

One-click install for WizardLM-13B-Uncensored with oobabooga webui

Craft custom Language Model Models (LLMs) effortlessly using Flock. Build LLMs for specific domains like a pro, supported by wizardlm, bloom, falcon, and llama. Extract insights from text and images seamlessly. Powered by Python, pdfMiner, langChain, and streamLit. Unlock domain-specific intelligence with Flock! 🚀

Node-RED Flow (and web page example) for the WizardLM AI model