Skip to content

Commit 0dafc25

Browse files
committed
Fix RepititionPenalty from int to float
1 parent 62936df commit 0dafc25

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

models/generate_option.go

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -28,7 +28,7 @@ type GenerateOptions struct {
2828
TopP *float64 `json:"top_p,omitempty"`
2929
TopK *uint `json:"top_k,omitempty"`
3030
RandomSeed *uint `json:"random_seed,omitempty"`
31-
RepetitionPenalty *uint `json:"repetition_penalty,omitempty"`
31+
RepetitionPenalty *float64 `json:"repetition_penalty,omitempty"`
3232
MinNewTokens *uint `json:"min_new_tokens,omitempty"`
3333
MaxNewTokens *uint `json:"max_new_tokens,omitempty"`
3434
StopSequences *[]string `json:"stop_sequences,omitempty"`

0 commit comments

Comments
 (0)