Skip to content

Commit

Permalink
Update carte_cli/extractor/glue_extractor.py
Browse files Browse the repository at this point in the history
Co-authored-by: Balint Haller <hallerio@users.noreply.github.com>
  • Loading branch information
IstvanM and Balint Haller authored Mar 30, 2022
1 parent 6c5c499 commit 48d4e55
Showing 1 changed file with 1 addition and 6 deletions.
7 changes: 1 addition & 6 deletions carte_cli/extractor/glue_extractor.py
Original file line number Diff line number Diff line change
Expand Up @@ -54,12 +54,7 @@ def _get_glue_table_columns(
schema_parts_count = int(
row["Parameters"]["spark.sql.sources.schema.numParts"]
)
schema_str = ""
for part in range(0, schema_parts_count):
schema_str = (
schema_str
+ row["Parameters"][f"spark.sql.sources.schema.part.{part}"]
)
schema_str = ''.join([row["Parameters"][f"spark.sql.sources.schema.part.{part}"] for part in range(schema_parts_count)])
schema = json.loads(schema_str)
else:
print(table_name)
Expand Down

0 comments on commit 48d4e55

Please sign in to comment.