Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Run the same task in parallel to x times? #138

Open
abusquets opened this issue Mar 19, 2022 · 1 comment
Open

Run the same task in parallel to x times? #138

abusquets opened this issue Mar 19, 2022 · 1 comment

Comments

@abusquets
Copy link

Reading the documentation I know that celery-director can run tasks in parallel
https://ovh.github.io/celery-director/guides/build-workflows/#launch-tasks-in-parallel
But I have a question related to this feature.
What is the definition to run the same task in parallel to x times?

Task A: retrieve list of news
Task B: retrieve detail

Thanks

@ncrocfer
Copy link
Member

Hi @abusquets ,

Unfortunately this feature is not possible in Celery Director as we don't allow dynamic workflows. The original objective of this project was to provide an easy way to build simple workflows, so dynamic workflows are not supported.

I keep your issue opened for future discussions. For instance we think to provide helpers used to create tasks in the code itself, it can be a solution for your usecase. But I prefer to be honest, it's not a priority for now and I'm not sure when we'll be able to provide this feature :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants