Skip to content

Commit b968911

Browse files
committed
Added data validation in macro scenario.
1 parent 7c0f4ac commit b968911

File tree

2 files changed

+3
-2
lines changed

2 files changed

+3
-2
lines changed

src/e2e-test/features/gcs/source/GCSSourceToBigQuery.feature

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -501,7 +501,7 @@ Feature: GCS source - Verification of GCS to BQ successful data transfer
501501
Then Enter runtime argument value "ignoreNonExistingFolders" for GCS source property path key "IgnoreNonExistingFolders"
502502
Then Enter runtime argument value "encrypted" for GCS source property path key "DataFileEncrypted"
503503
Then Enter runtime argument value "encryptedMetadataSuffix" for GCS source property path key "testmeta"
504-
Then Enter runtime argument value "gcsFileSysProperty" for key "FileSystemPr"
504+
Then Enter runtime argument value "gcsCSVFileSysProperty" for key "FileSystemPr"
505505
Then Enter runtime argument value "fileEncoding" for key "Encode"
506506
Then Enter runtime argument value "gcsPathFieldOutputSchema" for key "gcsOutputSchema"
507507
Then Enter runtime argument value "projectId" for key "bqProjectId"
@@ -535,7 +535,7 @@ Feature: GCS source - Verification of GCS to BQ successful data transfer
535535
Then Enter runtime argument value "ignoreNonExistingFolders" for GCS source property path key "IgnoreNonExistingFolders"
536536
Then Enter runtime argument value "encrypted" for GCS source property path key "DataFileEncrypted"
537537
Then Enter runtime argument value "encryptedMetadataSuffix" for GCS source property path key "testmeta"
538-
Then Enter runtime argument value "gcsFileSysProperty" for key "FileSystemPr"
538+
Then Enter runtime argument value "gcsCSVFileSysProperty" for key "FileSystemPr"
539539
Then Enter runtime argument value "fileEncoding" for key "Encode"
540540
Then Enter runtime argument value "gcsPathFieldOutputSchema" for key "gcsOutputSchema"
541541
Then Enter runtime argument value "projectId" for key "bqProjectId"

src/e2e-test/resources/pluginParameters.properties

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -109,6 +109,7 @@ gcsDataTypeTest2File=testdata/GCS_DATATYPE_TEST_2.csv
109109
gcsReadRecursivePath=testdata/GCS_RECURSIVE_TEST
110110
gcsReadWildcardPath=testdata/GCS_WILDCARD_TEST,testdata/GCS_WILDCARD_TEST/test
111111
gcsFileSysProperty={"textinputformat.record.delimiter": "@"}
112+
gcsCSVFileSysProperty={"csvinputformat.record.csv": "1"}
112113
gcsDatatypeChange=[{"key":"createddate","value":"datetime"},{"key":"revenue","value":"double"},\
113114
{"key":"points","value":"decimal"},{"key":"BytesData","value":"bytes"}]
114115
gcsDataTypeTestFileSchema=[{"key":"id","value":"int"},{"key":"name","value":"string"},\

0 commit comments

Comments
 (0)