Skip to content
This repository has been archived by the owner on Jun 24, 2024. It is now read-only.

Per-command models #14

Open
philpax opened this issue Jun 21, 2023 · 0 comments
Open

Per-command models #14

philpax opened this issue Jun 21, 2023 · 0 comments
Labels
enhancement New feature or request

Comments

@philpax
Copy link
Collaborator

philpax commented Jun 21, 2023

Instead of loading a single model upfront, each command should have their own model associated (or an option to use the "root" model). Not sure about the memory management strategy yet - always force mmap for multi-model support?
@philpax philpax added the enhancement New feature or request label Jun 21, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@philpax