v1.58.2-dev2

What's Changed

• build(pyproject.toml): bump uvicorn depedency requirement + Azure o1 model check fix + Vertex Anthropic headers fix by @krrishdholakia in #7773
• Add gemini/ frequency_penalty + presence_penalty support by @krrishdholakia in #7776
• feat(helm): add securityContext and pull policy values to migration job by @Hexoplon in #7652
• fix confusing save button label by @yujonglee in #7778
• [integrations/lunary] Improve Lunary documentaiton by @hughcrt in #7770
• Fix wrong URL for internal user invitation by @yujonglee in #7762
• Update instructor tutorial by @Winston-503 in #7784

New Contributors

• @Winston-503 made their first contribution in #7784

Full Changelog: v1.58.2...v1.58.2-dev2

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.58.2-dev2

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name	Status	Median Response Time (ms)	Average Response Time (ms)	Requests/s	Failures/s	Request Count	Failure Count	Min Response Time (ms)	Max Response Time (ms)
/chat/completions	Passed ✅	200.0	215.31102581586012	6.152564490107213	0.0	1841	0	176.80144700000255	3405.0107850000018
Aggregated	Passed ✅	200.0	215.31102581586012	6.152564490107213	0.0	1841	0	176.80144700000255	3405.0107850000018