Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ci: split GPU test to two pools #893

Closed
wants to merge 4 commits into from
Closed

ci: split GPU test to two pools #893

wants to merge 4 commits into from

Conversation

t-vi
Copy link
Collaborator

@t-vi t-vi commented Jul 31, 2024

Thank you @Borda for great advice and branch.

@t-vi t-vi requested review from Borda and lantiga as code owners July 31, 2024 08:09
@github-actions github-actions bot added the ci label Jul 31, 2024
Copy link
Member

@Borda Borda left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

it is running the expected machine

@t-vi t-vi enabled auto-merge (squash) July 31, 2024 08:33
@t-vi t-vi disabled auto-merge July 31, 2024 08:34
@t-vi
Copy link
Collaborator Author

t-vi commented Jul 31, 2024

But it seems that the distributed is very slow?

@Borda
Copy link
Member

Borda commented Jul 31, 2024

But it seems that the distributed is very slow?

true, it goes from 14min to 24min so may be worse to investigate if it is HW or CUDA issue

@t-vi t-vi marked this pull request as draft August 1, 2024 06:51
@t-vi
Copy link
Collaborator Author

t-vi commented Aug 20, 2024

The A100 pool still is inexplicably slow, so I'm closing this for now, we might look into it again when we need to increase the parallel jobs.

@t-vi t-vi closed this Aug 20, 2024
@github-actions github-actions bot deleted the ci/gpu branch November 20, 2024 00:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants