Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add Dataset integration tests - S3 Share requests #1389

Merged
merged 97 commits into from
Sep 25, 2024
Merged

Add Dataset integration tests - S3 Share requests #1389

merged 97 commits into from
Sep 25, 2024

Commits on Jul 1, 2024

  1. Add integration tests for datasets - basic queries and conftest

    @dlpzx
    dlpzx committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    b188538 View commit details
    Browse the repository at this point in the history

  2. add list + get queries, add persistent datasets, begin create/update/… 

    …delete tests
    @noah-paige
    noah-paige committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    45d1407 View commit details
    Browse the repository at this point in the history

Commits on Jul 2, 2024

  1. Add integration test role in Environment stack + session in conftest … 

    …+ aws clients for dataset
    @dlpzx
    dlpzx committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    cd27097 View commit details
    Browse the repository at this point in the history

  2. simplified conftests for datasets

    @dlpzx
    dlpzx committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    d04b525 View commit details
    Browse the repository at this point in the history

  3. create integration role with region in name

    @noah-paige
    noah-paige committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    5e5507e View commit details
    Browse the repository at this point in the history

Commits on Jul 3, 2024

  1. New environment type: IntegrationTests + ssm param with tooling accou… 

    …nt id
    @dlpzx
    dlpzx committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    fa69dde View commit details
    Browse the repository at this point in the history

  2. Error on cdk add_to_policy

    @dlpzx
    dlpzx committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    3e19596 View commit details
    Browse the repository at this point in the history

Commits on Jul 4, 2024

  1. Add filter term include tags datasets

    @noah-paige
    noah-paige committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    c05de67 View commit details
    Browse the repository at this point in the history

  2. Add sample data and tests for dataset role access

    @noah-paige
    noah-paige committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    8f2a918 View commit details
    Browse the repository at this point in the history

  3. Add sample data and tests for dataset role access

    @noah-paige
    noah-paige committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    9b2c711 View commit details
    Browse the repository at this point in the history

  4. set up structure

    Sofia Sazonova committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    d30c121 View commit details
    Browse the repository at this point in the history

Commits on Jul 5, 2024

  1. in get_or_create_persistent_env argument of delete_env must be env-ob… 

    …ject
    Sofia Sazonova committed Jul 5, 2024
    Configuration menu
    Copy the full SHA
    2bad8bd View commit details
    Browse the repository at this point in the history

  2. create|update|submit simple share

    Sofia Sazonova committed Jul 5, 2024
    Configuration menu
    Copy the full SHA
    6214964 View commit details
    Browse the repository at this point in the history

  3. testdata.json -> gitignore

    Sofia Sazonova committed Jul 5, 2024
    Configuration menu
    Copy the full SHA
    3972e05 View commit details
    Browse the repository at this point in the history

Commits on Jul 8, 2024

  1. Add assume role permissions to codebuild role

    @dlpzx
    dlpzx committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    2dcd60f View commit details
    Browse the repository at this point in the history

  2. Add naming checks in clients + create table

    @dlpzx
    dlpzx committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    c261da7 View commit details
    Browse the repository at this point in the history

  3. Add permissions, confidentiality and commented tests

    @dlpzx
    dlpzx committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    1e9732b View commit details
    Browse the repository at this point in the history

  4. second share + autoapproval test

    Sofia Sazonova committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    cf8553c View commit details
    Browse the repository at this point in the history

  5. revert persistent environment

    @dlpzx
    dlpzx committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    5ea8b6b View commit details
    Browse the repository at this point in the history

  6. Fix check_stack_ready in dataset creation

    @dlpzx
    dlpzx committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    520a34e View commit details
    Browse the repository at this point in the history

  7. full cycle test

    Sofia Sazonova committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    0cf4ea7 View commit details
    Browse the repository at this point in the history

  8. Revert session environment and add tests

    @dlpzx
    dlpzx committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    972c883 View commit details
    Browse the repository at this point in the history

  9. fix integration role datasets

    @noah-paige
    noah-paige committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    7b1c942 View commit details
    Browse the repository at this point in the history

Commits on Jul 9, 2024

  1. Fix presigned URL upload test

    @noah-paige
    noah-paige committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    d9042dc View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'refs/remotes/origin/main' into feat/int… 

    …egration-tests-datasets-pt2

# Conflicts:
#	tests_new/integration_tests/core/environment/global_conftest.py
#	tests_new/integration_tests/modules/s3_datasets/global_conftest.py
#	tests_new/integration_tests/modules/s3_datasets/test_s3_dataset.py
    @dlpzx
    dlpzx committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    928c3aa View commit details
    Browse the repository at this point in the history

  3. decouple tests, test dependencies

    Sofia Sazonova committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    a996273 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'mda-main' into share-int-tests

    Sofia Sazonova committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    023fbc4 View commit details
    Browse the repository at this point in the history

  5. Uncomment drafted table/folder tests

    @dlpzx
    dlpzx committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    b633938 View commit details
    Browse the repository at this point in the history

Commits on Aug 29, 2024

  1. Merge branch 'mda-main' into share-int-tests

    Sofia Sazonova committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    74cb6fe View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2024

  1. conftest

    Sofia Sazonova committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    c05df65 View commit details
    Browse the repository at this point in the history

Commits on Sep 2, 2024

  1. persistent dataset for share testing

    Sofia Sazonova committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    50e1a60 View commit details
    Browse the repository at this point in the history

Commits on Sep 3, 2024

  1. Merge branch 'feat/integration-tests-datasets-pt2' into share-int-tests

    Sofia Sazonova committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    7897028 View commit details
    Browse the repository at this point in the history

  2. half way

    Sofia Sazonova committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    45f5078 View commit details
    Browse the repository at this point in the history

Commits on Sep 4, 2024

  1. Merge branch 'mda-main' into share-int-tests

    Sofia Sazonova committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    43cde66 View commit details
    Browse the repository at this point in the history

Commits on Sep 5, 2024

  1. Merge branch 'refs/heads/main' into feat/integration-tests-datasets-pt2

    @dlpzx
    dlpzx committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    2330021 View commit details
    Browse the repository at this point in the history

  2. Ruff and readme

    @dlpzx
    dlpzx committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    a857d0a View commit details
    Browse the repository at this point in the history

  3. all tests fixed

    Sofia Sazonova committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    6abe590 View commit details
    Browse the repository at this point in the history

  4. Split dataset tests and added signature of each test for all APIs. Fi… 

    …x issue with retry decorator
    @dlpzx
    dlpzx committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    5968fd3 View commit details
    Browse the repository at this point in the history

  5. tests for share item types

    Sofia Sazonova committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    e4e9c12 View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2024

  1. Added all dataset query definitions and placeholders for tests

    @dlpzx
    dlpzx committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    052bc7e View commit details
    Browse the repository at this point in the history

  2. ShareableType fix

    Sofia Sazonova committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    e739a25 View commit details
    Browse the repository at this point in the history

  3. Started parametrization of tests

    @dlpzx
    dlpzx committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    9ad774e View commit details
    Browse the repository at this point in the history

  4. Started parametrization of tests

    @dlpzx
    dlpzx committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    146c45e View commit details
    Browse the repository at this point in the history

  5. Started parametrization of tests

    @dlpzx
    dlpzx committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    0907ea3 View commit details
    Browse the repository at this point in the history

  6. Started parametrization of tests

    @dlpzx
    dlpzx committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    7f68d3b View commit details
    Browse the repository at this point in the history

Commits on Sep 9, 2024

  1. Added persistent tables and folders

    @dlpzx
    dlpzx committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    98c7667 View commit details
    Browse the repository at this point in the history

  2. Remove unnecessary tests in folders

    @dlpzx
    dlpzx committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    92f23e3 View commit details
    Browse the repository at this point in the history

  3. Fix issues with KMS datasets

    @dlpzx
    dlpzx committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    3907001 View commit details
    Browse the repository at this point in the history

  4. Temporary changes for persistent datasets

    @dlpzx
    dlpzx committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    3553d12 View commit details
    Browse the repository at this point in the history

  5. Add paramtrization in profiling, confidentiality, fix issue in glue t… 

    …ables
    @dlpzx
    dlpzx committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    9be25bb View commit details
    Browse the repository at this point in the history

  6. Fix s3_table tests, parametrized dataset tests

    @dlpzx
    dlpzx committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    1709bb5 View commit details
    Browse the repository at this point in the history

  7. Retouch preview_table tests

    @dlpzx
    dlpzx committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    6889c47 View commit details
    Browse the repository at this point in the history

  8. Merge branch 'feat/integration-tests-datasets-pt2' into share-int-tests

    Sofia Sazonova committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    aba8536 View commit details
    Browse the repository at this point in the history

  9. Fixed profiling tables tests

    @dlpzx
    dlpzx committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    3d67e2e View commit details
    Browse the repository at this point in the history

  10. Fixed profiling tables tests

    @dlpzx
    dlpzx committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    4fd56af View commit details
    Browse the repository at this point in the history

  11. Fix everything except for persistent-sse-s3 tests

    @dlpzx
    dlpzx committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    56b12c5 View commit details
    Browse the repository at this point in the history

Commits on Sep 10, 2024

  1. Fix API query to filter by tags + add README detail

    @dlpzx
    dlpzx committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    ade89e8 View commit details
    Browse the repository at this point in the history

  2. Wrong SSM parameter in README

    @dlpzx
    dlpzx committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    72259c4 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'refs/remotes/origin/main' into feat/int… 

    …egration-tests-datasets-pt2
    @dlpzx
    dlpzx committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    3b74b03 View commit details
    Browse the repository at this point in the history

  4. update share request|reject reasons

    Sofia Sazonova committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    b31d666 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'feat/integration-tests-datasets-pt2' into share-int-tests

    Sofia Sazonova committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    c220135 View commit details
    Browse the repository at this point in the history

  6. Moving fixture parameters to conftest

    @dlpzx
    dlpzx committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    196fb6e View commit details
    Browse the repository at this point in the history

  7. Update requisite in README

    @dlpzx
    dlpzx committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    d3bb8be View commit details
    Browse the repository at this point in the history

  8. cons role tests

    Sofia Sazonova committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    fbbccb7 View commit details
    Browse the repository at this point in the history

Commits on Sep 11, 2024

  1. PR review comments - functions to create AWS imported resources, names

    @dlpzx
    dlpzx committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    ec38ec0 View commit details
    Browse the repository at this point in the history

  2. PR review comments - 2

    @dlpzx
    dlpzx committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    ccb6887 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'refs/heads/main' into feat/integration-tests-datasets-pt2

    @dlpzx
    dlpzx committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    01c65c8 View commit details
    Browse the repository at this point in the history

Commits on Sep 12, 2024

  1. Issue persistent buckets

    @dlpzx
    dlpzx committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    5358677 View commit details
    Browse the repository at this point in the history

  2. Rewrite if-clause existing infra and resource for imported dataset

    @dlpzx
    dlpzx committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    590909b View commit details
    Browse the repository at this point in the history

  3. Merge branch 'feat/integration-tests-datasets-pt2' into share-int-tests

    Sofia Sazonova committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    adc48a3 View commit details
    Browse the repository at this point in the history

Commits on Sep 13, 2024

  1. crossaccount shares

    Sofia Sazonova committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    2c8724c View commit details
    Browse the repository at this point in the history

  2. readme

    Sofia Sazonova committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    1e3a2af View commit details
    Browse the repository at this point in the history

Commits on Sep 16, 2024

  1. add tables and folders

    Sofia Sazonova committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    c6cfd11 View commit details
    Browse the repository at this point in the history

  2. crossacc cons roles

    Sofia Sazonova committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    b32b269 View commit details
    Browse the repository at this point in the history

  3. second_test_aws_profile

    Sofia Sazonova committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    3907faa View commit details
    Browse the repository at this point in the history

  4. testdata and readme fix

    Sofia Sazonova committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    b2f78a0 View commit details
    Browse the repository at this point in the history

  5. testdata and readme fix

    Sofia Sazonova committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    4004389 View commit details
    Browse the repository at this point in the history

  6. remove unused

    Sofia Sazonova committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    ae400b1 View commit details
    Browse the repository at this point in the history

Commits on Sep 17, 2024

  1. Merge branch 'mda-main' into share-int-tests

    Sofia Sazonova committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    3b22dab View commit details
    Browse the repository at this point in the history

  2. Merge branch 'mda-main' into share-int-tests

    Sofia Sazonova committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    b3179d7 View commit details
    Browse the repository at this point in the history

  3. refactoring

    Sofia Sazonova committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    245ee77 View commit details
    Browse the repository at this point in the history

  4. check folder access and access point

    Sofia Sazonova committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    d1b78fb View commit details
    Browse the repository at this point in the history

  5. s3 account clean up script

    Sofia Sazonova committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    cf1f1ce View commit details
    Browse the repository at this point in the history

Commits on Sep 18, 2024

  1. verify share item access

    Sofia Sazonova committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    bfb0ede View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2024

  1. parametrize

    Sofia Sazonova committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    c0e7308 View commit details
    Browse the repository at this point in the history

Commits on Sep 20, 2024

  1. use env test role

    Sofia Sazonova committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    1fb405c View commit details
    Browse the repository at this point in the history

  2. add assumed role to trust relations

    Sofia Sazonova committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    2f2ca9a View commit details
    Browse the repository at this point in the history

  3. redo parametrization

    Sofia Sazonova committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    5b36c5d View commit details
    Browse the repository at this point in the history

Commits on Sep 23, 2024

  1. execute query -- hide logic in client

    Sofia Sazonova committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    f46a6bd View commit details
    Browse the repository at this point in the history

  2. PR changes

    Sofia Sazonova committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    9bf30c3 View commit details
    Browse the repository at this point in the history

Commits on Sep 24, 2024

  1. additional logging

    Sofia Sazonova committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    9125e05 View commit details
    Browse the repository at this point in the history

  2. session env instead of persistent env

    Sofia Sazonova committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    417f80d View commit details
    Browse the repository at this point in the history

  3. cdk

    Sofia Sazonova committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    29dfca7 View commit details
    Browse the repository at this point in the history

  4. typos

    Sofia Sazonova committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    384317b View commit details
    Browse the repository at this point in the history

  5. ruff

    Sofia Sazonova committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    5bf4106 View commit details
    Browse the repository at this point in the history

  6. cdk.json back to default

    Sofia Sazonova committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    6e9e9fd View commit details
    Browse the repository at this point in the history

  7. Merge branch 'main' into share-int-tests

    @SofiaSazonova
    SofiaSazonova authored Sep 24, 2024
    Configuration menu
    Copy the full SHA
    34d40f0 View commit details
    Browse the repository at this point in the history