Skip to content

Make tests and infrastructure less flaky#273

Merged
NikolaSimsic merged 12 commits intomainfrom
moo/update-tests
Jun 25, 2025
Merged

Make tests and infrastructure less flaky#273
NikolaSimsic merged 12 commits intomainfrom
moo/update-tests

Conversation

@NikolaSimsic
Copy link
Copy Markdown
Contributor

Scope of this PR:

  • Improve "Start runtime" phase with adding a retry mechanism since its failure leads to breaking a test
  • Add a timeout for each matrix test execution, it can happen that sometimes it gets stuck, leading to blocking the whole pipeline
  • Increasing SP version
  • Improve several test cases where image is loaded with a wait time in order to wait for image to load, it can take few seconds due to emulator/simulator limited resources
  • Update some screenshots and improve screenshot comparison logic with ignoring specific right part of the screen for android devices, scroll bar sometimes is displayed during execution and sometimes not, which leads to flakiness

@NikolaSimsic NikolaSimsic requested a review from a team as a code owner June 16, 2025 14:02
@NikolaSimsic NikolaSimsic force-pushed the moo/update-tests branch 3 times, most recently from e6d2b05 to a5e5547 Compare June 19, 2025 09:08
@NikolaSimsic NikolaSimsic force-pushed the moo/update-tests branch 2 times, most recently from 1778cd0 to 8da1cbf Compare June 19, 2025 10:29
@NikolaSimsic NikolaSimsic merged commit ae65935 into main Jun 25, 2025
7 of 8 checks passed
@NikolaSimsic NikolaSimsic deleted the moo/update-tests branch June 25, 2025 11:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants