Skip to content

Commit

Permalink
[sp] Fix download paging.
Browse files Browse the repository at this point in the history
- should fetch more results based on the search returns, rather then the
number of headers those link to.
  • Loading branch information
ajparsons committed Dec 23, 2024
1 parent de66a56 commit b43ad2d
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion pyscraper/sp_2024/download.py
Original file line number Diff line number Diff line change
Expand Up @@ -72,7 +72,7 @@ def get_debate_groupings(start_date: str, end_date: str) -> list[DebateGrouping]
start_date, end_date, search_page
)
meeting_urls.extend(page_result_urls)
if heading_count < 10:
if len(page_result_urls) < 10:
keep_fetching = False
else:
search_page += 1
Expand Down

0 comments on commit b43ad2d

Please sign in to comment.