Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A

Runs LLaMA with Extremely HIGH speed

LLM inference in Fortran

The bare metal in my basement

Portable LLM - A rust library for LLM inference

Simple large language model playground app

Wrapper for simplified use of Llama2 GGUF quantized models.

Simple bot that transcribes Telegram voice messages. Powered by go-telegram-bot-api & whisper.cpp Go bindings.