Ollama Gateway is a FastAPI-based project that aims to provide a gateway for interacting with Ollama's backend services. It supports all the essential endpoints from Ollama's server, with plans to add extra features like authentication and rate limiting.
-
Full Endpoint Support
- Replicates the core endpoints provided by Ollama's backend server.
-
Authentication
- Implements secure user authentication with JWT tokens.
-
Role-Based Access Control (RBAC)
- Controls access to different endpoints based on user roles (e.g., admin, user, etc).
-
Rate Limiting
- Limits the number of requests users can make within a certain period to prevent abuse.