Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Parallel Execution of DuckDB Queries using iFrame #88

Merged
merged 43 commits into from
Aug 28, 2024
Merged

Parallel Execution of DuckDB Queries using iFrame #88

merged 43 commits into from
Aug 28, 2024

Commits on Aug 14, 2024

  1. WIP Parallel exec

    @itsTalwar
    itsTalwar committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    f030e31 View commit details
    Browse the repository at this point in the history

Commits on Aug 21, 2024

  1. Communication Ref

    @itsTalwar
    itsTalwar committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    beabf09 View commit details
    Browse the repository at this point in the history

  2. IG manager

    @itsTalwar
    itsTalwar committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    2455b28 View commit details
    Browse the repository at this point in the history

  3. WIP

    @itsTalwar
    itsTalwar committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    b8839b4 View commit details
    Browse the repository at this point in the history

  4. WIP: file register

    @vpbs2
    vpbs2 committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    5ec3051 View commit details
    Browse the repository at this point in the history

  5. WIP: parallel memory manager

    @vpbs2
    vpbs2 committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    da424a4 View commit details
    Browse the repository at this point in the history

  6. WIP

    @itsTalwar
    itsTalwar committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    9cff6ca View commit details
    Browse the repository at this point in the history

  7. Get messages working

    @itsTalwar
    itsTalwar committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    81e0c31 View commit details
    Browse the repository at this point in the history

  8. Little more fix

    @itsTalwar
    itsTalwar committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    5b1fa7e View commit details
    Browse the repository at this point in the history

  9. It works idk how

    @itsTalwar
    itsTalwar committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    a5932c0 View commit details
    Browse the repository at this point in the history

Commits on Aug 22, 2024

  1. fix: duplicate query execution

    @vpbs2
    vpbs2 committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    09c797e View commit details
    Browse the repository at this point in the history

  2. Late night work

    @itsTalwar
    itsTalwar committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    926d74b View commit details
    Browse the repository at this point in the history

  3. Merge back

    @itsTalwar
    itsTalwar committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    21de9ff View commit details
    Browse the repository at this point in the history

Commits on Aug 23, 2024

  1. some: cleanup

    @vpbs2
    vpbs2 committed Aug 23, 2024
    Configuration menu
    Copy the full SHA
    266aaaa View commit details
    Browse the repository at this point in the history

  2. Added comment

    @itsTalwar
    itsTalwar committed Aug 23, 2024
    Configuration menu
    Copy the full SHA
    0fc1bbc View commit details
    Browse the repository at this point in the history

  3. Merge branch 'feat/parallel-exec' of github.com:devrev/meerkat into f… 

    …eat/parallel-exec
    @itsTalwar
    itsTalwar committed Aug 23, 2024
    Configuration menu
    Copy the full SHA
    d0c3456 View commit details
    Browse the repository at this point in the history

Commits on Aug 24, 2024

  1. update: cache logic

    @vpbs2
    vpbs2 committed Aug 24, 2024
    Configuration menu
    Copy the full SHA
    e42e80f View commit details
    Browse the repository at this point in the history

Commits on Aug 25, 2024

  1. Feat/parallel exec nik (#83) 

    * Dynamic list

* Clear memory and db

* Type fix

* Clean up and add parsing for JSON

* Fix E2E

* Remove unwanted file
    @itsTalwar
    itsTalwar authored Aug 25, 2024
    Configuration menu
    Copy the full SHA
    dcd0853 View commit details
    Browse the repository at this point in the history

  2. Remove hardcoding of origin (#85) 

    * Remove hardcoding

* Remove unwanted stuff

* Remove log
    @itsTalwar
    itsTalwar authored Aug 25, 2024
    Configuration menu
    Copy the full SHA
    e9d9a22 View commit details
    Browse the repository at this point in the history

  3. test(parallel-dbm): add tests for parallel dbm (#84) 

    * add: tests

* update: path

* update: mock
    @vpbs2
    vpbs2 authored Aug 25, 2024
    Configuration menu
    Copy the full SHA
    4415ba8 View commit details
    Browse the repository at this point in the history

Commits on Aug 26, 2024

  1. SharedArrayBuffer via Single domain (#86) 

    * Shared Array Paralle ecec

* Remove migrations.json

* Add logs for debugging
    @itsTalwar
    itsTalwar authored Aug 26, 2024
    Configuration menu
    Copy the full SHA
    afd7e7d View commit details
    Browse the repository at this point in the history

  2. fix(parallel-dbm): fix target and app id (#87) 

    * Shared Array Paralle ecec

* Remove migrations.json

* Add logs for debugging

* fix: app id

* update: index html

---------

Co-authored-by: itsTalwar <nt@devrev.ai>
    @vpbs2 @itsTalwar
    vpbs2 and itsTalwar authored Aug 26, 2024
    Configuration menu
    Copy the full SHA
    b401c99 View commit details
    Browse the repository at this point in the history

  3. feat(parallel-dbm): convert json data to shared array (#90) 

    * handle: json shared array

* update: method
    @vpbs2
    vpbs2 authored Aug 26, 2024
    Configuration menu
    Copy the full SHA
    17e80d4 View commit details
    Browse the repository at this point in the history

  4. feat: Clean types and integrate events with runners (#91) 

    * Adding more comments and events

* remove as much as possible

* Fix types
    @itsTalwar
    itsTalwar authored Aug 26, 2024
    Configuration menu
    Copy the full SHA
    8ab7274 View commit details
    Browse the repository at this point in the history

  5. Reduce the size of iframe and remove unwanted file (#92)

    @itsTalwar
    itsTalwar authored Aug 26, 2024
    Configuration menu
    Copy the full SHA
    a168a1c View commit details
    Browse the repository at this point in the history

  6. handle: file loader buffer type (#94)

    @vpbs2
    vpbs2 authored Aug 26, 2024
    Configuration menu
    Copy the full SHA
    b56b0ec View commit details
    Browse the repository at this point in the history

  7. chore(dbm): cleanup parallel dbm (#95) 

    * some cleanup

* remove: unwanted change
    @vpbs2
    vpbs2 authored Aug 26, 2024
    Configuration menu
    Copy the full SHA
    e231514 View commit details
    Browse the repository at this point in the history

  8. fix: types

    @vpbs2
    vpbs2 committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    356614b View commit details
    Browse the repository at this point in the history

  9. fix: type

    @vpbs2
    vpbs2 committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    75c4bc6 View commit details
    Browse the repository at this point in the history

  10. fix: test env

    @vpbs2
    vpbs2 committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    a7074f5 View commit details
    Browse the repository at this point in the history

  11. fix: test fix attempt 1

    @vpbs2
    vpbs2 committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    0a70c8b View commit details
    Browse the repository at this point in the history

  12. update: test

    @vpbs2
    vpbs2 committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    bca126d View commit details
    Browse the repository at this point in the history

  13. update: package

    @vpbs2
    vpbs2 committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    e5e8941 View commit details
    Browse the repository at this point in the history

  14. fix: build

    @vpbs2
    vpbs2 committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    f5bd093 View commit details
    Browse the repository at this point in the history

  15. fix: lint

    @vpbs2
    vpbs2 committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    7822865 View commit details
    Browse the repository at this point in the history

  16. Use node 18

    @itsTalwar
    itsTalwar committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    914149e View commit details
    Browse the repository at this point in the history

  17. Do npm ci instead of install

    @itsTalwar
    itsTalwar committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    cc9eb92 View commit details
    Browse the repository at this point in the history

  18. Fix types

    @itsTalwar
    itsTalwar committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    4dfb093 View commit details
    Browse the repository at this point in the history

Commits on Aug 27, 2024

  1. fix: address comments

    @vpbs2
    vpbs2 committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    3ca8b10 View commit details
    Browse the repository at this point in the history

  2. fix: types

    @vpbs2
    vpbs2 committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    69c22cb View commit details
    Browse the repository at this point in the history

Commits on Aug 28, 2024

  1. update: ref

    @vpbs2
    vpbs2 committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    3e97c31 View commit details
    Browse the repository at this point in the history

  2. update: gc

    @vpbs2
    vpbs2 committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    d100f94 View commit details
    Browse the repository at this point in the history

  3. address comments

    @vpbs2
    vpbs2 committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    8fdc30e View commit details
    Browse the repository at this point in the history