Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Model observability for Ollama #1230

Conversation

ThomasVitale
Copy link
Contributor

@ThomasVitale ThomasVitale commented Aug 16, 2024

Add instrumentation to Ollama integration to support observability for chat and embedding models.

Demo app for manual verification: https://github.com/ThomasVitale/llm-apps-java-spring-ai/tree/main/10-observability/observability-models-ollama

Signed-off-by: Thomas Vitale <ThomasVitale@users.noreply.github.com>
@markpollack
Copy link
Member

merged in 10e1e13

made some changes to run multiple Ollama ITs reusing the same container, see notes in BaseOllamaIT

@markpollack markpollack added this to the 1.0.0-M2 milestone Aug 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants