Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add Dataset integration tests - Table Columns #1548

Merged
merged 54 commits into from
Sep 24, 2024
Merged

Add Dataset integration tests - Table Columns #1548

merged 54 commits into from
Sep 24, 2024

Commits on Jul 1, 2024

  1. Add integration tests for datasets - basic queries and conftest

    @dlpzx
    dlpzx committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    b188538 View commit details
    Browse the repository at this point in the history

  2. add list + get queries, add persistent datasets, begin create/update/… 

    …delete tests
    @noah-paige
    noah-paige committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    45d1407 View commit details
    Browse the repository at this point in the history

Commits on Jul 2, 2024

  1. Add integration test role in Environment stack + session in conftest … 

    …+ aws clients for dataset
    @dlpzx
    dlpzx committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    cd27097 View commit details
    Browse the repository at this point in the history

  2. simplified conftests for datasets

    @dlpzx
    dlpzx committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    d04b525 View commit details
    Browse the repository at this point in the history

  3. create integration role with region in name

    @noah-paige
    noah-paige committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    5e5507e View commit details
    Browse the repository at this point in the history

Commits on Jul 3, 2024

  1. New environment type: IntegrationTests + ssm param with tooling accou… 

    …nt id
    @dlpzx
    dlpzx committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    fa69dde View commit details
    Browse the repository at this point in the history

  2. Error on cdk add_to_policy

    @dlpzx
    dlpzx committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    3e19596 View commit details
    Browse the repository at this point in the history

Commits on Jul 4, 2024

  1. Add filter term include tags datasets

    @noah-paige
    noah-paige committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    c05de67 View commit details
    Browse the repository at this point in the history

  2. Add sample data and tests for dataset role access

    @noah-paige
    noah-paige committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    8f2a918 View commit details
    Browse the repository at this point in the history

  3. Add sample data and tests for dataset role access

    @noah-paige
    noah-paige committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    9b2c711 View commit details
    Browse the repository at this point in the history

Commits on Jul 8, 2024

  1. Add assume role permissions to codebuild role

    @dlpzx
    dlpzx committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    2dcd60f View commit details
    Browse the repository at this point in the history

  2. Add naming checks in clients + create table

    @dlpzx
    dlpzx committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    c261da7 View commit details
    Browse the repository at this point in the history

  3. Add permissions, confidentiality and commented tests

    @dlpzx
    dlpzx committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    1e9732b View commit details
    Browse the repository at this point in the history

  4. revert persistent environment

    @dlpzx
    dlpzx committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    5ea8b6b View commit details
    Browse the repository at this point in the history

  5. Fix check_stack_ready in dataset creation

    @dlpzx
    dlpzx committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    520a34e View commit details
    Browse the repository at this point in the history

  6. Revert session environment and add tests

    @dlpzx
    dlpzx committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    972c883 View commit details
    Browse the repository at this point in the history

  7. fix integration role datasets

    @noah-paige
    noah-paige committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    7b1c942 View commit details
    Browse the repository at this point in the history

Commits on Jul 9, 2024

  1. Fix presigned URL upload test

    @noah-paige
    noah-paige committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    d9042dc View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'refs/remotes/origin/main' into feat/int… 

    …egration-tests-datasets-pt2

# Conflicts:
#	tests_new/integration_tests/core/environment/global_conftest.py
#	tests_new/integration_tests/modules/s3_datasets/global_conftest.py
#	tests_new/integration_tests/modules/s3_datasets/test_s3_dataset.py
    @dlpzx
    dlpzx committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    928c3aa View commit details
    Browse the repository at this point in the history

  3. Uncomment drafted table/folder tests

    @dlpzx
    dlpzx committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    b633938 View commit details
    Browse the repository at this point in the history

Commits on Sep 5, 2024

  1. Merge branch 'refs/heads/main' into feat/integration-tests-datasets-pt2

    @dlpzx
    dlpzx committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    2330021 View commit details
    Browse the repository at this point in the history

  2. Ruff and readme

    @dlpzx
    dlpzx committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    a857d0a View commit details
    Browse the repository at this point in the history

  3. Split dataset tests and added signature of each test for all APIs. Fi… 

    …x issue with retry decorator
    @dlpzx
    dlpzx committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    5968fd3 View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2024

  1. Added all dataset query definitions and placeholders for tests

    @dlpzx
    dlpzx committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    052bc7e View commit details
    Browse the repository at this point in the history

  2. Started parametrization of tests

    @dlpzx
    dlpzx committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    9ad774e View commit details
    Browse the repository at this point in the history

  3. Started parametrization of tests

    @dlpzx
    dlpzx committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    146c45e View commit details
    Browse the repository at this point in the history

  4. Started parametrization of tests

    @dlpzx
    dlpzx committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    0907ea3 View commit details
    Browse the repository at this point in the history

  5. Started parametrization of tests

    @dlpzx
    dlpzx committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    7f68d3b View commit details
    Browse the repository at this point in the history

Commits on Sep 9, 2024

  1. Added persistent tables and folders

    @dlpzx
    dlpzx committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    98c7667 View commit details
    Browse the repository at this point in the history

  2. Remove unnecessary tests in folders

    @dlpzx
    dlpzx committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    92f23e3 View commit details
    Browse the repository at this point in the history

  3. Fix issues with KMS datasets

    @dlpzx
    dlpzx committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    3907001 View commit details
    Browse the repository at this point in the history

  4. Temporary changes for persistent datasets

    @dlpzx
    dlpzx committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    3553d12 View commit details
    Browse the repository at this point in the history

  5. Add paramtrization in profiling, confidentiality, fix issue in glue t… 

    …ables
    @dlpzx
    dlpzx committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    9be25bb View commit details
    Browse the repository at this point in the history

  6. Fix s3_table tests, parametrized dataset tests

    @dlpzx
    dlpzx committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    1709bb5 View commit details
    Browse the repository at this point in the history

  7. Retouch preview_table tests

    @dlpzx
    dlpzx committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    6889c47 View commit details
    Browse the repository at this point in the history

  8. Fixed profiling tables tests

    @dlpzx
    dlpzx committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    3d67e2e View commit details
    Browse the repository at this point in the history

  9. Fixed profiling tables tests

    @dlpzx
    dlpzx committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    4fd56af View commit details
    Browse the repository at this point in the history

  10. Fix everything except for persistent-sse-s3 tests

    @dlpzx
    dlpzx committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    56b12c5 View commit details
    Browse the repository at this point in the history

Commits on Sep 10, 2024

  1. Fix API query to filter by tags + add README detail

    @dlpzx
    dlpzx committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    ade89e8 View commit details
    Browse the repository at this point in the history

  2. Wrong SSM parameter in README

    @dlpzx
    dlpzx committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    72259c4 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'refs/remotes/origin/main' into feat/int… 

    …egration-tests-datasets-pt2
    @dlpzx
    dlpzx committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    3b74b03 View commit details
    Browse the repository at this point in the history

  4. Moving fixture parameters to conftest

    @dlpzx
    dlpzx committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    196fb6e View commit details
    Browse the repository at this point in the history

  5. Update requisite in README

    @dlpzx
    dlpzx committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    d3bb8be View commit details
    Browse the repository at this point in the history

Commits on Sep 11, 2024

  1. PR review comments - functions to create AWS imported resources, names

    @dlpzx
    dlpzx committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    ec38ec0 View commit details
    Browse the repository at this point in the history

  2. PR review comments - 2

    @dlpzx
    dlpzx committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    ccb6887 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'refs/heads/main' into feat/integration-tests-datasets-pt2

    @dlpzx
    dlpzx committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    01c65c8 View commit details
    Browse the repository at this point in the history

Commits on Sep 12, 2024

  1. Issue persistent buckets

    @dlpzx
    dlpzx committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    5358677 View commit details
    Browse the repository at this point in the history

  2. Rewrite if-clause existing infra and resource for imported dataset

    @dlpzx
    dlpzx committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    590909b View commit details
    Browse the repository at this point in the history

Commits on Sep 13, 2024

  1. Small return issue

    @dlpzx
    dlpzx committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    0674531 View commit details
    Browse the repository at this point in the history

  2. Implement tests for S3 Tables columns

    @dlpzx
    dlpzx committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    f16efd7 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'refs/remotes/origin/main' into feat/int… 

    …egration-tests-datasets-pt4

# Conflicts:
#	tests_new/integration_tests/modules/s3_datasets/queries.py
#	tests_new/integration_tests/modules/s3_datasets/test_s3_tables_columns.py
    @dlpzx
    dlpzx committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    aea2d04 View commit details
    Browse the repository at this point in the history

Commits on Sep 17, 2024

  1. Merge branch 'refs/heads/main' into feat/integration-tests-datasets-pt4

    @dlpzx
    dlpzx committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    259ba27 View commit details
    Browse the repository at this point in the history

Commits on Sep 24, 2024

  1. nit comments on PR

    @dlpzx
    dlpzx committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    cdac5f7 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'refs/remotes/origin/main' into feat/int… 

    …egration-tests-datasets-pt4
    @dlpzx
    dlpzx committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    a34a6da View commit details
    Browse the repository at this point in the history