Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Easy relaunch of incomplete and disconnected tasks #713

Open
JackUrb opened this issue Mar 15, 2022 · 1 comment
Open

Easy relaunch of incomplete and disconnected tasks #713

JackUrb opened this issue Mar 15, 2022 · 1 comment
Labels
enhancement New feature or request

Comments

@JackUrb
Copy link
Contributor

JackUrb commented Mar 15, 2022

Overview

It's commonly the case (especially in pilots) that data that is annotated needs to be re-annotated due to misunderstood instructions or bad worker quality controls. It's also the case that in a coordinated live task, some data may not end up annotated because one of the workers disconnects, leaving the task as incomplete. We'd like to improve the experience for both of these cases

Implementation

For the first, this would involve extending the DataBrowser to allow querying all incomplete or rejected units, and then create a tools.scripts utility function that leverages it to construct a new set of static data to be fed directly to the SharedTaskState in a run script.
For the second, we'd need to modify the generators for the TaskLauncher to remain open for generating re-releases of incomplete tasks as they arise. One early attempt at doing this (and more discussion) can be found here: #224

@JackUrb JackUrb added this to the 🌠 Mephisto 1.2 milestone Jul 25, 2022
@JackUrb
Copy link
Contributor Author

JackUrb commented Sep 15, 2023

Code for resuming an incomplete run is present in #910, but hasn't been tested.

@meta-paul meta-paul added the enhancement New feature or request label Apr 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants