0.4.0

0.4.0 (2024-11-01)

🚀 Features

• Add headers in unique key computation (#609) (6c4746f) by @Prathamesh010
• Add pre_navigation_hooks to PlaywrightCrawler (#631) (5dd5b60) by @Prathamesh010
• Add always_enqueue option to bypass URL deduplication (#621) (4e59fa4) by @Rutam21
• Split and add extra configuration to export_data method (#580) (6751635) by @deshansh

🐛 Bug Fixes

• Use strip in headers normalization (#614) (a15b21e) by @vdusek
• Merge payload and data fields of Request (#542) (d06fcef) by @vdusek
• Default ProxyInfo port if httpx.URL port is None (#619) (8107a6f) by @steffansafey

Chore

• Remove Request.query_params field (#639) (6ec0ec4) by @vdusek

0.3.9

0.3.9 (2024-10-23)

🚀 Features

• Key-value store context helpers (#584) (fc15622) by @janbuchar
• Added get_public_url method to KeyValueStore (#572, closes #514) (3a4ba8f) by @akshay11298

🐛 Bug Fixes

• Workaround for JSON value typing problems (#581, closes #563) (403496a) by @janbuchar

0.3.8

0.3.8 (2024-10-03)

🚀 Features

• Mask Playwright's "headless" headers (#545, closes #401) (d1445e4) by @vdusek
• Add new model for HttpHeaders (#544) (854f2c1) by @vdusek

🐛 Bug Fixes

• Call error_handler for SessionError (#557, closes #546) (e75ac4b) by @vdusek
• Extend from StrEnum in RequestState to fix serialization (#556, closes #551) (6bf35ba) by @vdusek
• Add equality check to UserData model (#562) (899a25c) by @janbuchar

0.3.7

0.3.7 (2024-09-25)

🐛 Bug Fixes

• Improve Request.user_data serialization (#540, closes #524) (de29c0e) by @janbuchar
• Adopt new version of curl-cffi (#543) (f6fcf48) by @vdusek

0.3.6

0.3.6 (2024-09-19)

🚀 Features

• Add HTTP/2 support for HTTPX client (#513, closes #512) (0eb0a33) by @vdusek
• Expose extended unique key when creating a new Request (#515) (1807f41) by @vdusek
• Add header generator and integrate it into HTTPX client (#530, closes #402) (b63f9f9) by @vdusek

🐛 Bug Fixes

• Use explicitly UTF-8 encoding in local storage (#533, closes #532) (a3a0ab2) by @vdusek

0.3.5

0.3.5 (2024-09-10)

🚀 Features

• Memory usage limit configuration via environment variables (#502) (c62e554) by @janbuchar

🐛 Bug Fixes

• Http clients detect 4xx as errors by default (#498, closes #496) (1895dca) by @vdusek
• Correctly handle log level configuration (#508) (7ea8fe6) by @janbuchar

0.3.4

0.3.4 (2024-09-05)

🐛 Bug Fixes

• Expose basic crawling context (#501) (b484535) by @vdusek

0.3.3

0.3.3 (2024-09-05)

🐛 Bug Fixes

• Deduplicate requests by unique key before submitting them to the queue (#499) (6a3e0e7) by @janbuchar

0.3.2

0.3.2 (2024-09-04)

🐛 Bug Fixes

• Double incrementation of item_count (#443, closes #442) (cd9adf1) by @cadlagtrader
• Field alias in BatchRequestsOperationResponse (#485) (126a862) by @janbuchar
• JSON handling with Parsel (#490, closes #488) (ebf5755) by @janbuchar

0.3.1

0.3.1 (2024-08-30)

🚀 Features

• Curl http client selects chrome impersonation by default (#473) (82dc939) by @vdusek