Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Investigate Lorax for serving several, small language models #64

Open
micheleriva opened this issue Jan 23, 2025 · 0 comments
Open

Investigate Lorax for serving several, small language models #64

micheleriva opened this issue Jan 23, 2025 · 0 comments
Assignees
@niltonheck
Labels
RAG Issues linked to retrival-augmented generation
Milestone
v1.0.0 Stable

Comments

@micheleriva
Copy link
Member

We need to investigate if we can use Lorax (https://github.com/predibase/lorax) for serving all of our fine-tuned models.
@micheleriva micheleriva added the enhancement New feature or request label Jan 23, 2025
@micheleriva micheleriva added this to the v1.0.0 Stable milestone Jan 23, 2025
@micheleriva micheleriva added RAG Issues linked to retrival-augmented generation and removed enhancement New feature or request labels Jan 23, 2025
@micheleriva micheleriva moved this to Todo in OramaCore Jan 23, 2025
@niltonheck niltonheck moved this from Todo to In Progress in OramaCore Jan 23, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@niltonheck niltonheck

Labels
RAG Issues linked to retrival-augmented generation
Projects
OramaCore
Status: In Progress
Milestone
v1.0.0 Stable
Development

No branches or pull requests
2 participants
@niltonheck @micheleriva