Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Warning when user backfills materialization without storage mapping #1409

Open
dyaffe opened this issue Dec 20, 2024 · 3 comments
Open

Warning when user backfills materialization without storage mapping #1409

dyaffe opened this issue Dec 20, 2024 · 3 comments
Assignees
Labels
edit Editing an entity enhancement New feature or request

Comments

@dyaffe
Copy link
Member

dyaffe commented Dec 20, 2024

Proposal
We have a ton of users that try to backfill a materialization rather than a capture. This works fine if they have storage mappings but doesn't work well if they don't have them and their collection is more than 20 days old.

It would be nice if we could pop up a warning message in two scenarios:

  1. They backfill a collection that's over 20 days old which uses our trial bucket.
  • "Your account uses Estuary's Trial bucket which includes 20 days of storage and this collection is older than that. Data will be missing if you backfill from the materialization so we recommend backfilling from the source."
  1. They add a collection that is over 20 days old to a materialization.
  • "Your account uses Estuary's Trial bucket which includes 20 days of storage and this collection is older than that. To ensure you have all data, please also backfill this collection from the source after adding it to the materialization."
@travjenkins travjenkins added enhancement New feature or request edit Editing an entity labels Dec 26, 2024
@travjenkins
Copy link
Member

This should be aggressive and the user should need to dismiss this to continue doing what they are doing. This REALLY causes issues and needs to be made clear to the user.

@kiahna-tucker kiahna-tucker self-assigned this Jan 23, 2025
@jwhartley
Copy link

jwhartley commented Jan 31, 2025

Is it possible to link to the capture that we're suggesting they backfill as part of the message?
I would also recommend including a link to information + instructions about storage mapping and configuring their own

@travjenkins
Copy link
Member

Linking to the capture is a bit outside of this request. Since there could be n captures needing backfilled the UX will need to be fleshed out a bit.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
edit Editing an entity enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

4 participants