feat: Add OTEL providers (OpenAI v1/v2, Mastra, LlamaIndex) #24
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Split OpenAI OTEL provider into separate v1 and v2 implementations to support both community and official instrumentation approaches: v1 (opentelemetry-instrumentation-openai): - Community maintained package - Sends everything as span attributes (metadata + message content) - Only requires traces endpoint - Simpler setup, single endpoint v2 (opentelemetry-instrumentation-openai-v2): - Official OpenTelemetry package - Sends metadata as span attributes - Sends message content as separate log events - Requires both traces and logs endpoints - Follows official GenAI semantic conventions This allows users to test and compare both approaches.
Add OTEL instrumentation providers for both Node.js and Python ecosystems: Node.js - Mastra OTEL Provider (✅ Working): - Add mastra-otel.ts provider using Mastra's automatic OTEL instrumentation - Integrate as provider #18 in index.ts - Add @mastra/core and @mastra/otel dependencies to package.json - Add test scripts: test_mastra_otel.ts and run_mastra_test.sh - Successfully sends traces to PostHog OTLP endpoint Python - LlamaIndex OTEL Provider (⏸️ Deferred): - Add llamaindex_otel.py provider for RAG queries with OTEL tracing - Integrate as provider #14 in main.py - Add llama-index dependencies to requirements.txt - Note: Deferred due to LlamaIndex's unique span events architecture (stores data in OTEL span events rather than attributes/logs) Test Infrastructure: - Add OTEL test scripts for validation and debugging - Add test_event_logger.py for event inspection - Add run_otel_tests.sh for batch testing This extends the app to support v1 OTEL instrumentation patterns (data in span attributes) from modern frameworks like Mastra, complementing the existing v2 support (metadata in spans, content in logs). 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com>
![github-advanced-security[bot]](https://avatars.githubusercontent.com/in/57789?s=60&v=4){kind=small}
…ensitive information Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
andrewm4894
changed the title
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary
Adds OpenTelemetry instrumentation providers for both Node.js and Python ecosystems to demonstrate automatic tracing with PostHog's OTEL ingestion endpoint.
Changes
Python - OpenAI OTEL v1 Provider (#12) ✅
openai_otel.py→openai_otel_v1.pyfor clarityopentelemetry-instrumentation-openaipackagePython - OpenAI OTEL v2 Provider (#13) ✅
openai_otel_v2.pyusing officialopentelemetry-instrumentation-openai-v2Python - LlamaIndex OTEL Provider (#14) ⏸️ Deferred
llamaindex_otel.pyfor RAG queries with OTEL tracingNode.js - Mastra OTEL Provider (#18) ✅
mastra-otel.tsprovider using Mastra's@mastra/otel-exporterTest Infrastructure
python/scripts/otel/with test scripts for SDK, v1, and v2 comparisonnode/scripts/otel/with Mastra test scriptrun_otel_tests.shbatch runner for validationDependencies
opentelemetry-instrumentation-openai-v2,llama-index-*packages@mastra/otel-exporter,tsxTesting
Tested locally with PostHog OTEL ingestion endpoint:
Run all Python OTEL tests:
Run Mastra test:
Related