Skip to content

Reduce RAM usage, fix VRAM OOMs, and fix Windows shared memory spilling with adaptive model loading #11845

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
rattus128 wants to merge 34 commits into
base: master
Choose a base branch
from
+984 −109

MPDynamic: Add support for model defined dtype

2d96b2f
Select commit
Loading
Failed to load commit list.
Open

Reduce RAM usage, fix VRAM OOMs, and fix Windows shared memory spilling with adaptive model loading #11845

MPDynamic: Add support for model defined dtype
2d96b2f
Select commit
Loading
Failed to load commit list.
Socket Security / Socket Security: Project Report succeeded Jan 21, 2026 in 7s

Project Report: Success

Report Status Message
Project report ✅ View full report

Click through to the see the full socket security project report page for this commit to see information about every dependency in this project.

View more details on Socket Security