Skip to content

Conversation

@willpote
Copy link
Contributor

@willpote willpote commented Dec 2, 2025

Large refactor of our indexer + exposing it as an API for the explorer. Many breaking changes, so we will wipe the databases in Prod when this is deployed.

Changes:
1/ Now fetches all data (events, block metadata, etc) in advance, with various parallelization and caches to file storage / S3
2/ Support for different RPC providers for different calls.
3/ Support for different APIs for fetching TX metadata. Either getting the full block and parsing receipts, or fetching the transactions individually. Different strategies are more efficient on different RPC providers
4/ Precomputes aggregations hourly/daily/weekly/monthly
5/ Support for running backfills

Core logic to review:
crates/indexer/src/market/core.rs

Copy link
Contributor

@capossele capossele left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Tested the entire day, functionally approved

@willpote willpote merged commit 05cf506 into main Dec 5, 2025
21 checks passed
@willpote willpote deleted the willpote/market-indexer-api branch December 5, 2025 18:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants