Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Bug]: Gemini does not support parameters 'frequency_penalty' #7748

Closed
AyrennC opened this issue Jan 13, 2025 · 0 comments · Fixed by #7776
Closed

[Bug]: Gemini does not support parameters 'frequency_penalty' #7748

AyrennC opened this issue Jan 13, 2025 · 0 comments · Fixed by #7776
Assignees
@krrishdholakia
Labels
bug Something isn't working

Comments

@AyrennC
Copy link

AyrennC commented Jan 13, 2025 •
edited
Loading

What happened?

I encountered this error for all gemini models I have tested so far, gemini/gemini-2.0-flash, gemini/gemini-1.5-flash, gemini/gemini-1.5-pro.

Relevant log output

Error: 400 litellm.UnsupportedParamsError: gemini does not support parameters: {'frequency_penalty': 0.5}, for model=gemini-2.0-flash.

Are you a ML Ops Team?

No

What LiteLLM version are you on ?

ghcr.io/berriai/litellm:main-latest

Twitter / LinkedIn details

No response
@AyrennC AyrennC added the bug Something isn't working label Jan 13, 2025
@krrishdholakia krrishdholakia self-assigned this Jan 15, 2025
krrishdholakia added a commit that referenced this issue Jan 15, 2025
@krrishdholakia
fix(gemini/): support gemini 'frequency_penalty' and 'presence_penalty'
ad80b0d 
Closes #7748
@krrishdholakia krrishdholakia mentioned this issue Jan 15, 2025
Merged
rajatvig pushed a commit to rajatvig/litellm that referenced this issue Jan 16, 2025
@krrishdholakia @rajatvig
Litellm dev 01 2025 p4 (BerriAI#7776)
d6a3092 
* fix(gemini/): support gemini 'frequency_penalty' and 'presence_penalty'

Closes BerriAI#7748

* feat(proxy_server.py): new env var to disable prisma health check on startup

* test: fix test
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@krrishdholakia krrishdholakia

Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Add gemini/ frequency_penalty + presence_penalty support BerriAI/litellm
2 participants
@krrishdholakia @AyrennC