Anthropic models hosted on vertex do not work

[portkey-support]

What Happened?

On October 17, 2024; Venge wrote

I just created a Vertex AI virtual key. The Gemini models work fine but the Anthropic models fail. Seems you are using a wrong endpoint: "vertex-ai error: Publisher Model projects/celtic-pulsar-437515-n6/locations/europe-west3/publishers/google/models/claude-3-5-sonnet@20240620 not found."

What Should Have Happened?

Right endpoint is "publishers/anthropic/models/claude-3-5-sonnet". We really need this, would be great if you could fix this soon!

Relevant Code Snippet

No response

Your Twitter/LinkedIn

No response

[portkey-support]

Hey @venge sorry if the documentation was missing this info, but in the model for anthropic hosted on vertex you need to pass it this way:
anthropic.claude-3-5-sonnet@20240620
that should fix # 1
Updated the docs with this info
https://portkey.ai/docs/integrations/llms/vertex-ai#3-invoke-chat-completions-with-vertex-ai-and-gemini