Skip to content

v7.12.1
Compare
Choose a tag to compare
@sakan811 sakan811 released this 23 Sep 12:39
· 304 commits to master since this release
v7.12.1
e24fb42
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.

Performance & Refactoring:

  • Transitioned from dataclass to Pydantic for scrapers for better data validation.
  • Refactored major files like main.py, check_missing_dates.py, and graphql_scraper.py for maintainability and clarity.
  • General code refactoring, including removing utils.py and updating flowcharts and UML diagrams.

Dependency Updates:

  • Updated critical dependencies such as pytest, requests, aiohttp, duckdb, and pytest-asyncio to their latest versions for improved stability.

Testing Enhancements:

  • Added and adjusted test cases to improve code coverage and reliability.
  • Implemented test cases for argument parsers and error handling (e.g., KeyError).

Scraping & Automation:

  • Fixed the automated scraper, updated the scraper's logic, and enhanced scrape_missing_dates() for better accuracy.
  • Added threading and argparse improvements for better scraper control and efficiency.

Documentation & Workflow:

  • Updated README and added/adjusted documentation for arguments and flow.
  • Integrated Ruff linting into the GitHub workflow to maintain code quality.
Assets 2
Loading