Skip to content

Commit 385229a

Browse files
committed
Set GGML_TRAINING_CTX to 2048 (otherwise it breaks 8k tuned models hard)
1 parent f29e4d9 commit 385229a

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

ggml.h

+1-1
Original file line numberDiff line numberDiff line change
@@ -204,7 +204,7 @@
204204
// Maximum training context of the model in use
205205
// For the LLaMA models this is normally 2048, but somehow "stepping out" by 128 gives better results (tested at 7B and 13B)
206206
#ifndef GGML_TRAINING_CTX
207-
#define GGML_TRAINING_CTX 2176
207+
#define GGML_TRAINING_CTX 2048
208208
#endif
209209

210210
#define GGML_ASSERT(x) \

0 commit comments

Comments
 (0)