Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Modifies nightly.sh to add a new step for unbounded table read. #72

Conversation

prashastia
Copy link
Collaborator

Adds a new step in the nightly job

  1. the unbounded table read.
  2. Also adds the call to unbounded_table_read.sh via the common table_read.sh

/gcbrun

This module is similar to the BigQueryExample. A few changes to count the number of records and log them.
This test reads a simpleTable.
Shell script and python script to check the number of records read.
This test reads a simpleTable.
Shell script and python script to check the number of records read.
This test reads a simpleTable.
Shell script and python script to check the number of records read.
This test reads a simpleTable.
Shell script and python script to check the number of records read.
This test reads a simpleTable.
Shell script and python script to check the number of records read.
This test reads a simpleTable.
Shell script and python script to check the number of records read.
comments CODECOV_TOKEN usage.
…ds to different tables required for the e2e tests.
…eneration.

 The records can be string, long, records type.
…rementally into the partitioned table. Used by the e2e unbounded source testing script.
…ob, Dynamically adds partitions and then kills the dataproc job.
…dds the call to unbounded_table_read.sh via the common table_read.sh
@prashastia prashastia closed this Dec 24, 2023
@prashastia prashastia deleted the nightly-tests-unbounded-read-4 branch December 24, 2023 12:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant