Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Return Iceberg metadata tables in SQLAlchemy reflection #519

Open
1 task done
metadaddy opened this issue Jan 15, 2025 · 1 comment
Open
1 task done

Return Iceberg metadata tables in SQLAlchemy reflection #519

metadaddy opened this issue Jan 15, 2025 · 1 comment
Labels
enhancement New feature or request

Comments

@metadaddy
Copy link
Member

Describe the feature

The Iceberg metadata tables, $partitions, $manifests, $files, etc, should be available via SQLAlchemy reflection, perhaps by specifying a dialect-specific keyword such as trino_include_metadata_tables.

There does not currently appear to be a way to get the server to list the metadata tables for an Iceberg table, so the client might just have to 'know' that they exist.

Describe alternatives you've considered

You could hardcode the list of metadata table names into a client app, but this would be vulnerable to changes in the Iceberg connector implementation that might introduce new metadata tables.

Are you willing to submit PR?

  • Yes I am willing to submit a PR!
@hashhar hashhar added the enhancement New feature or request label Jan 16, 2025
@hashhar
Copy link
Member

hashhar commented Jan 16, 2025

Sounds reasonable to me. Would also be good to check what the JDBC driver's DatabaseMetaData#getTables does for comparison.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Development

No branches or pull requests

2 participants