Initial release of Prime—a one-click toolkit for provisioning servers to deploy and serve Large Language Models (LLMs).
Features
- Support for cloud-provider agnostic deployments
- Initial support for Paperspace cloud instances
- Dashboard w/ UI for server creation, instance management, server management, server playground, ACLs, and more
- Backend w/ API access to all UI flows
- Client-side PII redaction via pyodide background worker