Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix E2E node state provision by using mithril on all platforms #4918

Open
2 of 4 tasks
Tracked by #4917
paolino opened this issue Jan 9, 2025 · 2 comments
Open
2 of 4 tasks
Tracked by #4917

Fix E2E node state provision by using mithril on all platforms #4918

paolino opened this issue Jan 9, 2025 · 2 comments
Assignees
Labels
CI CI related Improvement Mark a PR as an improvement, for auto-generated CHANGELOG

Comments

@paolino
Copy link
Collaborator

paolino commented Jan 9, 2025

Why

ATM we are copying the preprod state from a directory on the builder before starting the E2E. There is a buildkite action to update it but it's broken. Update preprod snapshot
On windows the state is coming from AWS storage.

Downloading snapshots from any other place requires that

  • or we maintain the infrastructure and update the content
  • or we rely on unreliable external providers

Mithril is external and reliable

What

Inline download of preprod state via mithril for E2E tests on all platforms

How

  • Remove preprod cache for Linux E2E
  • Remove preprod cache for MacOS E2E
  • Use Mithril to download preprod state in Windows E2E
  • Cleanup old snapshots mgmt parts

Acceptance

  • https://downloads.csnapshots.io/ regex is removed from the repository
  • E2E tests still work on all 3 platforms
  • Preprod state is not cached anymore
  • The admin buildkite pipeline has no steps to update the cache
@paolino paolino added the CI CI related label Jan 9, 2025
@paolino paolino added this to the 2025Q1 milestone Jan 9, 2025
@paolino paolino changed the title Use Mithril to download preprod state in Linux E2E Use Mithril to download preprod state Jan 9, 2025
@abailly
Copy link
Collaborator

abailly commented Jan 9, 2025

Do we really need 3 different issues here?

@paolino paolino changed the title Use Mithril to download preprod state Remove uses of cnapshot.io from the repository Jan 9, 2025
@paolino paolino changed the title Remove uses of cnapshot.io from the repository Fix E2E state provision by using mithril on all platforms Jan 9, 2025
@paolino paolino changed the title Fix E2E state provision by using mithril on all platforms Fix E2E node state provision by using mithril on all platforms Jan 9, 2025
@paolino
Copy link
Collaborator Author

paolino commented Jan 9, 2025

Do we really need 3 different issues here?

Probably not, I'm investigating

@paolino paolino added the Improvement Mark a PR as an improvement, for auto-generated CHANGELOG label Jan 9, 2025
paolino added a commit that referenced this issue Jan 9, 2025
- Update the mithril instructions to refresh the preprod state for the
E2E tests

#4918
@abailly abailly removed this from the 2025Q1 milestone Jan 10, 2025
@paolino paolino self-assigned this Jan 15, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CI CI related Improvement Mark a PR as an improvement, for auto-generated CHANGELOG
Projects
None yet
Development

No branches or pull requests

2 participants