Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update Python Scrapy Actor template to use the Request Queue as storage #183

Closed
vdusek opened this issue Aug 31, 2023 · 0 comments · Fixed by #184
Closed

Update Python Scrapy Actor template to use the Request Queue as storage #183

vdusek opened this issue Aug 31, 2023 · 0 comments · Fixed by #184
Assignees
@vdusek
Labels
enhancement New feature or request. product roadmap Issues contributing to product roadmap. t-tooling Issues with this label are in the ownership of the tooling team.
Milestone
72nd sprint - Too...

Comments

@vdusek
Copy link
Contributor

vdusek commented Aug 31, 2023 •
edited
Loading

Current behavior

  • Python Scrapy Actor uses Scrapy's default Scheduler with its default storage.

Expected behavior

  • Python Scrapy Actor uses our custom (asynchronous) Scheduler with our Request Queue as a storage.

Possible solutions

Additional context
@vdusek vdusek added enhancement New feature or request. t-tooling Issues with this label are in the ownership of the tooling team. labels Aug 31, 2023
@vdusek vdusek self-assigned this Aug 31, 2023
@vdusek vdusek mentioned this issue Aug 31, 2023
Merged
@B4nan B4nan added the product roadmap Issues contributing to product roadmap. label Sep 11, 2023
vdusek added a commit that referenced this issue Sep 13, 2023
@vdusek
Python Scrapy Actor uses Request Queue (#184)
7762e1a 
Closes #183
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@vdusek vdusek

Labels
enhancement New feature or request. product roadmap Issues contributing to product roadmap. t-tooling Issues with this label are in the ownership of the tooling team.
Projects
None yet
Milestone
72nd sprint - Tooling team
Development

Successfully merging a pull request may close this issue.

Python Scrapy Actor uses Request Queue apify/actor-templates
2 participants
@B4nan @vdusek