Skip to content

ChainMetadataAggregator Integration #1629

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
Jun 13, 2025

Conversation

dioptx
Copy link
Collaborator

@dioptx dioptx commented Jun 2, 2025

This is the first PR for the Total Crypto metadata integration. It provides the appropriate structure to base further additions and allows for smaller follow up PRs.

Additions:

  • Created pipeline: build_all_chains_metadata() with 7 processing steps
  • Dagster asset: all_chains_metadata_asset with config schema
  • Config fields: output_bq_table, manual_mappings_filepath, bq_project_id, bq_dataset_id
  • CLI command: build-metadata under opdata chains
  • Registered Dagster asset module in defs.py

@dioptx dioptx requested a review from MSilb7 June 2, 2025 11:11
@dioptx dioptx self-assigned this Jun 2, 2025
@dioptx dioptx requested a review from a team as a code owner June 2, 2025 11:11
Copy link
Member

@MSilb7 MSilb7 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Made one comment about maybe writing out what each step is supposed to do, so we can align on that before writing code.

otherwise, agree on a modular-type approach & the data sources go through a few steps before we create the massive joined dataset

@dioptx dioptx merged commit e7d8dd5 into main Jun 13, 2025
6 checks passed
dioptx added a commit that referenced this pull request Jul 11, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants