Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make @retry_endpoint a default for all test #1725

Merged
merged 3 commits into from
Oct 12, 2023
Merged

Conversation

Wauplin
Copy link
Contributor

@Wauplin Wauplin commented Oct 12, 2023

We currently use @retry_endpoint on endpoint tests to retry on HTTPError 504 or OSError (git clone race condition). It has being introduced in #682 to improve stability of the CI. What's still annoying is that it is a decorator that has to be added to every test case individually -which is prone to forgetting. This PR updates the CI by automatically applying the retry mechanism to all tests.

(Note: if in the future we specifically want to opt-out some tests, it is still doable using a pytest.mark. But I don't see a reason to do it.).

@Wauplin Wauplin requested a review from LysandreJik October 12, 2023 14:38
@HuggingFaceDocBuilderDev
Copy link

HuggingFaceDocBuilderDev commented Oct 12, 2023

The documentation is not available anymore as the PR was closed or merged.

@codecov
Copy link

codecov bot commented Oct 12, 2023

Codecov Report

All modified lines are covered by tests ✅

Comparison is base (dd18be7) 49.19% compared to head (5b6c8c7) 82.50%.

Additional details and impacted files
@@             Coverage Diff             @@
##             main    #1725       +/-   ##
===========================================
+ Coverage   49.19%   82.50%   +33.31%     
===========================================
  Files          62       62               
  Lines        7265     7265               
===========================================
+ Hits         3574     5994     +2420     
+ Misses       3691     1271     -2420     

see 45 files with indirect coverage changes

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link
Member

@LysandreJik LysandreJik left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me! Thanks @Wauplin

@Wauplin
Copy link
Contributor Author

Wauplin commented Oct 12, 2023

Thanks for the quick review!

@Wauplin Wauplin merged commit 51d9e94 into main Oct 12, 2023
16 checks passed
@Wauplin Wauplin deleted the rerun-any-flaky-test branch October 12, 2023 15:36
@Wauplin Wauplin mentioned this pull request Dec 15, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants