Pinned Loading

1. gpustack gpustack Public

   Simple, scalable AI model deployment on GPU clusters

   Python 4k 399

2. gguf-parser-go gguf-parser-go Public

   Review/Check GGUF files and estimate the memory usage and maximum tokens per second.

   Go 214 22

3. llama-box llama-box Public

   LM inference server implementation based on *.cpp.

   C++ 289 27

4. vox-box vox-box Public

   A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.

   Python 171 25