Why is Zed making two API calls per for each submitted message at the start of a new conversation? #25375
mooreryan
started this conversation in
LLMs and Zed Assistant
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I have connected my Anthropic key to Zed assistant. I was monitoring the logs on Anthropic and I see two API calls per submitted assistant message when I start a new conversation. I would like to know why it is doing that. Is there a way I see what API calls Zed is actually making?
Looking at the API logs, the second call's input tokens are approximately the amount of the first call's input tokens + output tokens...so maybe it is has to do with the Anthropic prompt caching? Additional messages submitted in the same conversation appear not to trigger multiple calls per message, however.
Beta Was this translation helpful? Give feedback.
All reactions