Prototype(symbolization): Add symbolization in Pyroscope read path#3799

Open

marcsanmi wants to merge 31 commits intomainfrom

marcsanmi/symbolization-poc

Commits on Apr 22, 2025

feat(symbolization): Add DWARF symbolization POC with debuginfod support
marcsanmi
committed
fix lint errors
marcsanmi
committed
Add symbolization inside the read path
marcsanmi
committed
Add cache for debug files
marcsanmi
committed
Adding symbolizer instrumentation
marcsanmi
committed
chore: move symbolizatoin into query frontend & add intermediate representation for lookups in dwarf
marcsanmi
committed
fix lint and unstaged-changes check
marcsanmi
committed
Update symbolization to symbolize from pprof & improve deubginfod client
marcsanmi
committed
Add new flags help
marcsanmi
committed
Add multi-layered caching with LRU for symbols, Ristretto for debuginfo, and optimized DWARF parsing
marcsanmi
committed
fix testdata symbolized json files since we don't rely on unsymbolized oltp convert.go hack
marcsanmi
committed
fix another set of tests related to otlp conversion and help options
marcsanmi
committed
Address review several comments
marcsanmi
committed
place symbolizer flags registration under v2 umbrella
marcsanmi
committed
Add __needs_symbolization__ metadata label & made debuginfo store non-optional
marcsanmi
committed
Fix flags after rebase
marcsanmi
committed
update metadata labels to work with needs_symbolization & fix maxNodes
marcsanmi
committed
Address review and several fixes:
marcsanmi
committed
Made needsSymbolization thread-safe
marcsanmi
committed
Update .gitattributes w/ normalize
marcsanmi
committed
ensure valid existing symbolization is preserved
marcsanmi
committed
update symbols check by only checking lines length
marcsanmi
committed
refactor: added TreeFromBackendProfileSampleType for better performance over ConvertProfileToTree
marcsanmi
committed
refactor: move symbols logic from segment to head & change needsSymbolizion by hasNativeProfiles
marcsanmi
committed
feat: symbolize only otel-related profiles
marcsanmi
committed
TODO: review this commit, it has logs and otel only smbolization disabled
marcsanmi
committed
Change lidia write to accept interface
marcsanmi
committed
Use new Lidia format insitead of dwarf
marcsanmi
committed
Add Lidia binary layout support
marcsanmi
committed
Remove unnecessary debuginfod client raw files cache & address several review comments
marcsanmi
committed

Commits on Apr 29, 2025

feat: add symbolizer per tenant overrides (#4136)
marcsanmi
authored

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Prototype(symbolization): Add symbolization in Pyroscope read path#3799

Commits on Apr 22, 2025

feat(symbolization): Add DWARF symbolization POC with debuginfod support

fix lint errors

Add symbolization inside the read path

Add cache for debug files

Adding symbolizer instrumentation

chore: move symbolizatoin into query frontend & add intermediate representation for lookups in dwarf

fix lint and unstaged-changes check

Update symbolization to symbolize from pprof & improve deubginfod client

Add new flags help

Add multi-layered caching with LRU for symbols, Ristretto for debuginfo, and optimized DWARF parsing

fix testdata symbolized json files since we don't rely on unsymbolized oltp convert.go hack

fix another set of tests related to otlp conversion and help options

Address review several comments

place symbolizer flags registration under v2 umbrella

Add __needs_symbolization__ metadata label & made debuginfo store non-optional

Fix flags after rebase

update metadata labels to work with needs_symbolization & fix maxNodes

Address review and several fixes:

Made needsSymbolization thread-safe

Update .gitattributes w/ normalize

ensure valid existing symbolization is preserved

update symbols check by only checking lines length

refactor: added TreeFromBackendProfileSampleType for better performance over ConvertProfileToTree

refactor: move symbols logic from segment to head & change needsSymbolizion by hasNativeProfiles

feat: symbolize only otel-related profiles

TODO: review this commit, it has logs and otel only smbolization disabled

Change lidia write to accept interface

Use new Lidia format insitead of dwarf

Add Lidia binary layout support

Remove unnecessary debuginfod client raw files cache & address several review comments

Commits on Apr 29, 2025

feat: add symbolizer per tenant overrides (#4136)