Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Request for OpenAI/Azure support. #3

Open
rajatsadh24 opened this issue Apr 2, 2024 · 2 comments
Open

Request for OpenAI/Azure support. #3

rajatsadh24 opened this issue Apr 2, 2024 · 2 comments

Comments

@rajatsadh24
Copy link

rajatsadh24 commented Apr 2, 2024 •
edited
Loading

Please add support for OpenAI/Azure API along with the Anthropic.
@lmorandini
Copy link

lmorandini commented Apr 3, 2024 •
edited
Loading

Since we are at that, why not be able to use any back-end LLM (see liteLLM)?

@ljsweeny
Copy link

ljsweeny commented Apr 4, 2024

Is it possible to do something to reduce anthropic rate/token limits? I think this is tokens not calls, but I could be wrong.
'Number of request tokens has exceeded your rate limit (https://docs.anthropic.com/claude/reference/rate-limits). Please reduce the the prompt length or the maximum tokens requested, or try again later. You may also contact sales at https://www.anthropic.com/contact-sales to discuss your options for a rate limit increase.'

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@lmorandini @ljsweeny @rajatsadh24