v1.49.6

What's Changed

• (router testing) Add testing coverage for run_async_fallback and run_sync_fallback by @ishaan-jaff in #6256
• LiteLLM Minor Fixes & Improvements (10/15/2024) by @krrishdholakia in #6242
• (testing) Router add testing coverage by @ishaan-jaff in #6253
• (testing) add router unit testing for send_llm_exception_alert , router_cooldown_event_callback , cooldown utils by @ishaan-jaff in #6258
• Litellm router code coverage 3 by @krrishdholakia in #6274
• Remove "ask mode" from Canary search by @yujonglee in #6271
• LiteLLM Minor Fixes & Improvements (10/16/2024) by @krrishdholakia in #6265

Full Changelog: v1.49.5...v1.49.6

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.49.6

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name	Status	Median Response Time (ms)	Average Response Time (ms)	Requests/s	Failures/s	Request Count	Failure Count	Min Response Time (ms)	Max Response Time (ms)
/chat/completions	Passed ✅	250.0	286.97499258450677	6.169343856034057	0.0	1846	0	229.1845549999607	2911.2547339999537
Aggregated	Passed ✅	250.0	286.97499258450677	6.169343856034057	0.0	1846	0	229.1845549999607	2911.2547339999537