Skip to content
This repository was archived by the owner on Apr 27, 2025. It is now read-only.

v4.9.0
Compare
Choose a tag to compare
@sakan811 sakan811 released this 03 Jul 12:16
· 526 commits to master since this release
v4.9.0
ffefc4d

  • Improved handling of city and currency data in GraphQL responses and adjusted related tests.

  • Enhanced error handling:

    • Added exception handlers for missing total page numbers in GraphQL scrapers.
    • Added backup for hotel data when finding data from JSON responses.
    • Introduced handlers for ValueError, IndexError, ElementClickInterceptedException, and NoSuchWindowException.

  • Refactored scrapers:

    • Added a GraphQL scraper and updated the daily scraper to use it.
    • Removed the Month End scraper.
    • Improved handling of timezone issues for scrapers and tests, including a timezone parameter for check_if_current_date_has_passed.
    • Adjusted worker threads, WebDriver behavior, and logging setup for all scrapers.

  • Fixed bugs related to check_if_current_date_has_passed and date handling for Thread Pool and Month End scrapers.

  • Added more tests, exception handlers, and improved data-saving processes.

Assets 2
Loading