Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Migrate to channel and worker pool for download notifier #217

Conversation

fernandodeluret
Copy link
Collaborator

Start using a channel to process concurently DownloadMetadataInfo redis cmds

Copy link
Collaborator

@Nagaprasadvr Nagaprasadvr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

few things to update

grpc-ingest/src/config.rs Outdated Show resolved Hide resolved
program_transformers/src/bubblegum/mod.rs Show resolved Hide resolved
@kespinola kespinola dismissed Nagaprasadvr’s stale review February 3, 2025 12:16

Resolved PR and fine with the format change.

@kespinola kespinola merged commit 0e368c1 into grpc-ingest Feb 3, 2025
3 checks passed
@kespinola kespinola deleted the das-113-migrate-to-channel-and-worker-pool-for-download-notifier branch February 3, 2025 12:16
Nagaprasadvr pushed a commit that referenced this pull request Feb 5, 2025
* `wip` concurrent download metadata notifier with channels

* `chore` Clean debugging changes

* `chore` remove duplicated config files and debug trace

* Refactor to download metadata publisher

* Time metric for metadata josn publish

---------

Co-authored-by: Kyle Espinola <kyle.s.espinola@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants