-
Notifications
You must be signed in to change notification settings - Fork 556
Open
Description
qmd embed
Chunking 13831 documents by token count...
102 | else if (minContextSizeResourceRequirements.cpuRam > ramState.free + swapState.free - unifiedRamUsage)
103 | throw new InsufficientMemoryError(`A context size of ${minContextSize}${sequences > 1 ? ` with ${sequences} sequences` : ""} is too large for the available RAM${swapState.total > 0 ? " (including swap)" : ""}`);
104 | else if (minContextSizeResourceRequirements.cpuRam > ramState.free - unifiedRamUsage)
105 | throw new InsufficientMemoryError(`A context size of ${minContextSize}${sequences > 1 ? ` with ${sequences} sequences` : ""} is too large for the available RAM`);
106 | else
107 | throw new InsufficientMemoryError(`A context size of ${minContextSize}${sequences > 1 ? ` with ${sequences} sequences` : ""} is too large for the available resources`);
^
error: A context size of 8192 is too large for the available resources
at resolveContextContextSizeOption (/Users/timforsync/.bun/install/global/node_modules/node-llama-cpp/dist/gguf/insights/utils/resolveContextContextSizeOption.js:107:19)
I am using a Mac mini with 16G RAM, still more than half RAM available...
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels