Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: use progress bars in a lot more places #256

Merged
merged 1 commit into from
Aug 1, 2023
Merged

Conversation

mikix
Copy link
Contributor

@mikix mikix commented Aug 1, 2023

  • Bulk export gets a spinner
  • Each task gets 3 progress bars (prep, batches, finalize)
  • After the ETL run, print a final success message

Old vs New

Old:
Old
New:
New

Multiple Output tables

Screenshot from 2023-08-01 11-28-52

Bulk Progress Spinner

Screenshot from 2023-08-01 10-47-58

Screencast of New

Screencast.from.08-01-2023.11.14.32.AM.webm

Checklist

  • Consider if documentation (like in docs/) needs to be updated
  • Consider if tests should be added

@@ -136,37 +138,42 @@ async def _request_with_delay(
:param method: HTTP method to request
:returns: the HTTP response
"""
while self._total_wait_time < self._TIMEOUT_THRESHOLD:
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This whole change is basically just an indent to support a new Status region with one Text field that we write the ongoing updates to, instead of just printing them to the console.

- Bulk export gets a spinner
- Each task gets 3 progress bars (prep, batches, finalize)
- After the ETL run, print a final success message
failed = any(s.success < s.attempt for s in summaries)
if failed:
print("** One or more tasks above did not 100% complete! **", file=sys.stderr)
print("🚨 One or more tasks above did not 100% complete! 🚨", file=sys.stderr)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

that's the stuff

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I literally can't believe I didn't start with those

@mikix mikix merged commit c51b0b3 into main Aug 1, 2023
2 checks passed
@mikix mikix deleted the mikix/task-progress branch August 1, 2023 16:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants