Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: Split and add extra configuration to export_data method #580

Merged
merged 25 commits into from
Oct 31, 2024
Merged

feat: Split and add extra configuration to export_data method #580

merged 25 commits into from
Oct 31, 2024
+195 −24

Commits on Oct 7, 2024

  1. Splitted and added extra onfiguration to export_data

    @deshansh
    deshansh committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    0a84a72 View commit details
    Browse the repository at this point in the history

Commits on Oct 8, 2024

  1. Code refactor + review comments

    @deshansh
    deshansh committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    f56aeb4 View commit details
    Browse the repository at this point in the history

Commits on Oct 19, 2024

  1. chore(deps): update dependency typescript to v5.6.2 (apify#578)

    @renovate @deshansh
    renovate[bot] authored and deshansh committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    84ffb1a View commit details
    Browse the repository at this point in the history

  2. chore(deps): update dependency eslint-plugin-react to v7.37.1 (apify#577 

    )
    @renovate @deshansh
    renovate[bot] authored and deshansh committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    3d83ed3 View commit details
    Browse the repository at this point in the history

  3. ci: install Poetry to setup-python environment (apify#579) 

    Thanks @Mantisus.
    @vdusek @deshansh
    vdusek authored and deshansh committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    8b653a2 View commit details
    Browse the repository at this point in the history

  4. fix: Workaround for JSON value typing problems (apify#581) 

    - closes apify#563

@tlinhart any chance you could test this and confirm it fixes the issue?
    @janbuchar @deshansh
    janbuchar authored and deshansh committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    33acd8c View commit details
    Browse the repository at this point in the history

  5. chore(release): Update changelog and package version [skip ci]

    @deshansh
    Apify Release Bot authored and deshansh committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    96f7788 View commit details
    Browse the repository at this point in the history

  6. ci: use python version instead of executable path (apify#582)

    @vdusek @deshansh
    vdusek authored and deshansh committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    fc0d1b0 View commit details
    Browse the repository at this point in the history

  7. ci: fix python version reference in pipx install (apify#583)

    @vdusek @deshansh
    vdusek authored and deshansh committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    15c536d View commit details
    Browse the repository at this point in the history

  8. feat: Key-value store context helpers (apify#584) 

    - This adds a `get_key_value_store(id, name)` context helper to
`BasicCrawlingContext`
- Also, push_data calls are held until the request handler terminates
successfully (same as in JS version)
    - This is necessary for adaptive crawling (apify#249), among other things
    @janbuchar @deshansh
    janbuchar authored and deshansh committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    b12324e View commit details
    Browse the repository at this point in the history

  9. chore(release): Update changelog and package version [skip ci]

    @deshansh
    Apify Release Bot authored and deshansh committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    08097ba View commit details
    Browse the repository at this point in the history

  10. ci: rm unused pipeline (apify#591) 

    - rm unused pipeline
- use env var for node versions (same as we do for python)
    @vdusek @deshansh
    vdusek authored and deshansh committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    4a5dc9e View commit details
    Browse the repository at this point in the history

  11. ci: use shared workflows and refactor them (apify#593)

    @vdusek @deshansh
    vdusek authored and deshansh committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    7d08a19 View commit details
    Browse the repository at this point in the history

  12. ci: fix build and deploy docs workflow (apify#594)

    @vdusek @deshansh
    vdusek authored and deshansh committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    bc7358e View commit details
    Browse the repository at this point in the history

  13. chore: Automatic docs theme update [skip ci]

    @github-actions @deshansh
    github-actions[bot] authored and deshansh committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    800ac52 View commit details
    Browse the repository at this point in the history

  14. chore: fix doc commands in Makefile (apify#595)

    @vdusek @deshansh
    vdusek authored and deshansh committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    39f9cd9 View commit details
    Browse the repository at this point in the history

  15. Splitted and added extra onfiguration to export_data

    @deshansh
    deshansh committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    92fa67d View commit details
    Browse the repository at this point in the history

  16. Merge remote-tracking branch 'origin' into implement-extra-configurat… 

    …ion-exportdata
    @deshansh
    deshansh committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    3f2c4da View commit details
    Browse the repository at this point in the history

Commits on Oct 31, 2024

  1. Merge remote-tracking branch 'origin/master' into implement-extra-con… 

    …figuration-exportdata
    @janbuchar
    janbuchar committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    079ea5e View commit details
    Browse the repository at this point in the history

  2. (Sort of) bring back BasicCrawler.export_data

    @janbuchar
    janbuchar committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    588b7ce View commit details
    Browse the repository at this point in the history

  3. Typo

    @janbuchar
    janbuchar committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    231e0ce View commit details
    Browse the repository at this point in the history

  4. Docs, validation

    @janbuchar
    janbuchar committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    d05c084 View commit details
    Browse the repository at this point in the history

  5. Remove conflict marker residue

    @janbuchar
    janbuchar committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    26010d8 View commit details
    Browse the repository at this point in the history

  6. Add all possible export kwargs

    @janbuchar
    janbuchar committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    756c32b View commit details
    Browse the repository at this point in the history

  7. Fix type

    @janbuchar
    janbuchar committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    ac4fbb3 View commit details
    Browse the repository at this point in the history