Skip to content

Feature/update recipe#58

Merged
laurejt merged 7 commits intodevelopfrom
feature/update-recipe
Mar 30, 2026
Merged

Feature/update recipe#58
laurejt merged 7 commits intodevelopfrom
feature/update-recipe

Conversation

@laurejt
Copy link
Copy Markdown

@laurejt laurejt commented Mar 24, 2026

Associated Issue(s): resolves #49

Changes in this PR

  • Simplified task routing so that each annotator must annotate all examples for a given language.
  • Updated Q2 labels
  • Defined custom progress function so the progress bar in the dashboard reflects the annotator's progress
  • Removed reject button
  • Removed stats from progress panel
  • Reorganized the recipe function
  • Add recipe option to include instructions
  • Add validation for when Q3 response is required

Notes

  • This recipe requires the PRODIGY_ALLOWED_SESSIONS environment variable to be set.

Reviewer Checklist

  • Check that recipe can run locally both with and without the instructions option (--instruct, -I)
  • Confirm task routing behavior
  • Confirm progress bar reflects annotator-specific progress
  • Check that the web interface for the recipe looks reasonable
  • Confirm that added Q3 validation works

laurejt added 5 commits March 17, 2026 12:25
- Displays language for original text
- Set the history_text for each example
- Add option to include instructions
- Updated Q1 prompt
- Added evaluation typology to Q2
- Removed stats from progress panel
- Add validation for when Q3 response is required
@laurejt laurejt requested a review from rlskoeser March 24, 2026 18:41
Copy link
Copy Markdown

@rlskoeser rlskoeser left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The code changes look fine to me. Tagging Hao to review and test.

@rlskoeser rlskoeser requested a review from tanhaow March 25, 2026 19:39
Copy link
Copy Markdown

@tanhaow tanhaow left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for working on this! I’ve been able to run and test Prodigy locally without any issues for the tasks listed in the checklist.

But I noticed a few minor issues in the code. Please find them below.

laurejt and others added 2 commits March 30, 2026 12:48
@laurejt laurejt dismissed tanhaow’s stale review March 30, 2026 17:05

Checked in with Hao, she confirmed the changes she raised were minor and did not require another round of reviewing.

@laurejt laurejt merged commit a62f4f0 into develop Mar 30, 2026
1 check passed
@laurejt laurejt deleted the feature/update-recipe branch March 30, 2026 17:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants