Code

33 athena table#34

Code

Merged

oislen merged 6 commits intomainoislen/IrishClimateDashboard:mainfrom devoislen/IrishClimateDashboard:devCopy head branch name to clipboardOct 21, 2024

+92-15

Commits

Commits on Oct 21, 2024

• updated feather file to generate from cleaned parquet files

  oislen

  committed
  ac7f4b6

  Copy full SHA for ac7f4b6

• Added cleaned data cols reference json file. Added pyarrow schema for the clean data .parquet files

  oislen

  committed
  6327d63

  Copy full SHA for 6327d63

• Added cleaned data cols reference json file

  oislen

  committed
  258dee9

  Copy full SHA for 258dee9

• Expanded logic to write data based on key extension type, currently supports parquet and .csv

  oislen

  committed
  d328a17

  Copy full SHA for d328a17

• Loading cleaned parquet files

  oislen

  committed
  260adaa

  Copy full SHA for 260adaa

• Updated clean data process to output .parquet file instead of .csv. Adding any missing weather cols as None. Setting a defined clean data column order. Replacing all np.nan values with None

  oislen

  committed
  951dfa5

  Copy full SHA for 951dfa5