Web app to chat with LLM inference providers. Inspired by openwebui i thought it would be fun to make something similar.
Currently (2025-09) work in progress
Technology im planning to use
- Backend
- FastAPI (with SSE events and SQLAlchemy)
- Redis
- LLM inferencing (openai, deepinfra, fireworksai)
- Frontend
- Vue3
- Markdown rendering
- Mermaid charts