-
Notifications
You must be signed in to change notification settings - Fork 8
Open
Description
Is it possible to add handling for a 503 error from a model when running a loop by automatically switching to another model rather than failing? e.g from pro to flash or flash-lite. Here's the output:
✕ [API Error: {"error":{"message":"{\n \"error\": {\n \"code\": 503,\n \"message\": \"The model is overloaded. Please try again later.\",\n \"status\": \"UNAVAILABLE\"\n
}\n}\n","code":503,"status":"Service Unavailable"}}]
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels