-
Notifications
You must be signed in to change notification settings - Fork 190
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Parquet codec tests fix #4698
Parquet codec tests fix #4698
Conversation
@@ -115,11 +117,11 @@ void test_happy_case(final int numberOfRecords) throws Exception { | |||
parquetOutputCodec.writeEvent(event, outputStream); | |||
} | |||
parquetOutputCodec.complete(outputStream); | |||
List<Map<String, Object>> actualRecords = createParquetRecordsList(new ByteArrayInputStream(tempFile.toString().getBytes())); | |||
List<Map<String, Object>> actualRecords = createParquetRecordsList(new FileInputStream(tempFile)); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We need assertions on all of these to verify the size. Otherwise, the loop below will not assert anything.
assertThat(actualRecords.size(), equalTo(inputMaps.size()));
break; | ||
default: throw new IllegalArgumentException("Unknown field"); | ||
} | ||
} catch (RuntimeException e) {continue;} |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think we should remove this try-catch. Just let the exception propagate up.
Relatedly, there is an exception below. Can you remove it?
} catch (Exception parquetException) {
LOG.error("Failed to parse Parquet", parquetException);
.github/workflows/static.yml
Outdated
@@ -0,0 +1,43 @@ | |||
# Simple workflow for deploying static content to GitHub Pages |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think this was from a concept you were working. This commit shouldn't be in this branch.
Your DCO is failing. |
1faba56
to
86a100e
Compare
Signed-off-by: Krishna Kondaka <krishkdk@dev-dsk-krishkdk-2c-bd29c437.us-west-2.amazon.com>
Signed-off-by: Krishna Kondaka <krishkdk@dev-dsk-krishkdk-2c-bd29c437.us-west-2.amazon.com>
86a100e
to
e8aa74c
Compare
Signed-off-by: Krishna Kondaka <krishkdk@dev-dsk-krishkdk-2c-bd29c437.us-west-2.amazon.com>
Parquet codec tests fix Signed-off-by: Krishna Kondaka <krishkdk@dev-dsk-krishkdk-2c-bd29c437.us-west-2.amazon.com> (cherry picked from commit a466013)
Parquet codec tests fix Signed-off-by: Krishna Kondaka <krishkdk@dev-dsk-krishkdk-2c-bd29c437.us-west-2.amazon.com>
Parquet codec tests fix Signed-off-by: Krishna Kondaka <krishkdk@dev-dsk-krishkdk-2c-bd29c437.us-west-2.amazon.com>
Parquet codec tests fix Signed-off-by: Krishna Kondaka <krishkdk@dev-dsk-krishkdk-2c-bd29c437.us-west-2.amazon.com>
Parquet codec tests fix Signed-off-by: Krishna Kondaka <krishkdk@dev-dsk-krishkdk-2c-bd29c437.us-west-2.amazon.com>
Parquet codec tests fix Signed-off-by: Krishna Kondaka <krishkdk@dev-dsk-krishkdk-2c-bd29c437.us-west-2.amazon.com>
Parquet codec tests fix Signed-off-by: Krishna Kondaka <krishkdk@dev-dsk-krishkdk-2c-bd29c437.us-west-2.amazon.com>
Description
Fix Parquet output codec tests
Issues Resolved
Resolves #3992
Check List
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.