Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Restructure Nightly jobs to prevent flappers. #2664

Merged
merged 1 commit into from
Feb 3, 2025

Conversation

brandonpage
Copy link
Contributor

Other improvements:

  • Fixed Code Coverage reporting.
  • Use of two different Test Reporters (for now?):
    • One for PRs: This action understands and correctly reports "flaky" tests and tests that Firebase has re-run. But it does not display multiple test runs well (stating 2k+ tests ran and 1 failed does not tell me which API version it failed on). I have opened an issue asking for multi file support.
    • One for Nightlies: This action displays test results per file, so it is easy to tell what API levels tests pass or fail on. Reports tests that fail at first and succeed on the re-run as failures. I have commented on the issue asking for flaky/re-run support.
  • Increased the number of re-run attempts for PRs to 2 and decreased it to 0 for nightly runs (largely due to reporters).

@brandonpage brandonpage merged commit 8ab96fc into forcedotcom:dev Feb 3, 2025
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants