Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support more runner strategies #19

Open
thebongy opened this issue Sep 30, 2020 · 0 comments
Open

Support more runner strategies #19

thebongy opened this issue Sep 30, 2020 · 0 comments
Labels
enhancement New feature or request hacktoberfest Hacktoberfest 2020 help wanted Extra attention is needed

Comments

@thebongy
Copy link

thebongy commented Sep 30, 2020

Support more runner strategies

Currently, the runner is very straightforward, it executes every test case sequentially, there are different strategies it can support:

  1. Maybe the runner can execute multiple test cases in parallel, and you can possibly configure how many in parallel at a time. This is linked to the issue about leaking test cases from other tests you are not executing against, I mentioned a possible approach to handle this there (Test Cases may be leaked through RCE #15 (comment))
  2. The runner has the option of executing a certain group of test cases first, and only executing the others if the first group passes. This is a very common use case, as judging platforms want to often not run against private test cases if the sample test cases didn't pass in the first place. There are many solutions for this, maybe each test case can have a "depend_on" attribute which tells it depends on other test case to succeed, and only runs if that test case passed successfully.
@thebongy thebongy added enhancement New feature or request help wanted Extra attention is needed hacktoberfest Hacktoberfest 2020 labels Sep 30, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request hacktoberfest Hacktoberfest 2020 help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

1 participant