Version 1.8.0

We are pleased to announce the release of V1.8.0 of spack-stack.

The spack-stack package is a collaborative effort between the NOAA Environmental Modeling Center (EMC), the UCAR Joint Center for Satellite Data Assimilation (JCSDA), the Earth Prediction Innovation Center (EPIC), and the United States Naval Research Lab (NRL). spack-stack is designed to support the various applications of the supporting agencies such as the Unified Forecast System (UFS), the Joint Effort for Data assimilation Integration (JEDI), and the Navy Environmental Prediction sysTem Using a Nonhydrostatic Engine (NEPTUNE).

Documentation for installing and using spack-stack can be found at https://spack-stack.readthedocs.io/en/1.8.0 and https://github.com/JCSDA/spack-stack/wiki/spack%E2%80%90stack%E2%80%901.8.0-release-documentation

New This Release

• Support for Intel oneAPI 2024 compilers (icx, icpx, ifort; experimental: icx, icpx, ifx); update of Intel classic compilers to last release 2023.2 on NOAA platforms
• Bug fixes for Intel classic compilers in spack core code (always pass flags to suppress deprecation warnings to fix meson build errors)
• Support for AMD AOCC version 4 compilers (experimental)
• Minimal mpas-jedi environment with Nvidia compilers (nvhpc)
• New NEPTUNE standalone environment
• Environments now support one principal compiler, but can use other compilers for specific packages (examples: Intel classic environment uses gcc to compile boost; Intel oneAPI environment uses gcc to compile bison)
• Use Intel MKL instead of Openblas in Intel classic/oneAPI environments on all non-NOAA platforms
• Update of Python from 3.10.8 to 3.11.7 and update of numerous Python packages
• Additional packages for unified environment: py-dask, py-xnrl, py-wxflow, command line utilities for eccodes, py-fortranformat, bufr_query
• New versions of bufr@12.1.0, esmf@8.6.1 and esmf@8.7.0b11, mapl@2.46.3, fms@2024.02, g2@3.4.5.1, g2tmpl@1.13.0, eckit@1.27.0, ecmwf-atlas@0.38.1, met@11.1.1, wgrib@3.1.1, cdo@2.3.0
• Update to Rocky 8 for NOAA RDHPCS Hera, Jet, ParallelWorks
• Update to Rocky 9 for NOAA RDHPCS Orion
• Update of JEDI CI container builds
• New tier 1 platforms Atlantis, Gaea C6
• Update from spack develop as of May 2024
• Documentation updates: split documentation into readthedocs (https://spack-stack.readthedocs.io/en/latest) and a Wiki (https://github.com/JCSDA/spack-stack/wiki)

Version 1.7.0

We are pleased to announce the release of V1.7.0 of spack-stack.

The spack-stack package is a collaborative effort between the NOAA Environmental Modeling Center (EMC), the UCAR Joint Center for Satellite Data Assimilation (JCSDA), and the Earth Prediction Innovation Center (EPIC). spack-stack is designed to support the various applications of the supporting agencies such as the Unified Forecast System (UFS) or the Joint Effort for Data assimilation Integration (JEDI).

Documentation for installing and using spack-stack can be found here: https://spack-stack.readthedocs.io/en/1.7.0/

New This Release

• Add all packages required to build GEOS-GCM with spack-stack, add geos-gcm-env (thanks to Matthew Thompson from NASA GMAO)
• Extend support for spack-stack to NASA's Discover SCU17 (AMD Milan) partition, update Discover SCU16 (Intel CascadeLake) config
• Update Hera and Jet site configs after transition to Rocky 8
• Add metis and jasper to mpas-jedi-env
• Add fftw and netlib-lapack to jedi-neptune-env
• Add torch/pytorch for gcc and apple-clang environments
• Replace zlib with zlib-ng
• Remove upp from spack-stack installations
• Update ECMWF library versions (eccodes, eckit, fckit, ecmwf-atlas)
• Update esmf to 8.6.0, update mapl@2.40.3 dependencies (pflogger)
• Update hdf5 to 1.14.3 with backport of floating point exception fixes from hdf5 develop (thanks to Ryan Honeyager from tomorrow.io)
• Update sp, ip, gsibec
• Update OpenMPI version for user systems to 5.0.1
• Bugfix for crtm@2.4.0.1 static/fix files
• Bugfix for building py-jupyter server with node/npm
• Limited support for apple-clang@15.0.0
• Update to spack backports/v0.21.1
• Stop packages from access the internet during installation (needed for air-gapped systems)

Version 1.6.0

We are pleased to announce the release of V1.6.0 of spack-stack.

The spack-stack package is a collaborative effort between the NOAA Environmental Modeling Center (EMC), the UCAR Joint Center for Satellite Data Assimilation (JCSDA), and the Earth Prediction Innovation Center (EPIC). spack-stack is designed to support the various applications of the supporting agencies such as the Unified Forecast System (UFS) or the Joint Effort for Data assimilation Integration (JEDI).

Documentation for installing and using spack-stack can be found here: https://spack-stack.readthedocs.io/en/1.6.0/

New This Release

• Library updates: bufr@12.0.1, mapl@2.40.3 with esmf@8.6.0 in addition to mapl@2.40.3 with esmf@8.5.0, fms@2023.04, openblas@0.3.24, crtm@2.4.0.1, awscli-v2@2.13.22, eckit@1.24.5, ecmwf-atlas@0.35.1, netcdf-fortran@4.6.1, python@3.10.13, prod-util@2.1.1, eccodes@2.32.0,
• New packages: py-cylc-flow@8.2.3, py-cylc-rose@1.3.0, py-cylc-uiserver@1.3.0, mct@2.11.0, cprnc@1.0.3
• Support for GEOS SWELL workflow via the newly added geos-swell-env virtual package (available in unified-env and skylab-env)
• Additional environment gsi-addon-env that uses python@3.11.6, met@9.1.3, metplus@3.1.1
• Support of apple-clang@15.0.0 compiler
• Update of spack stack create ctr extension to build containers with different packages
• Update of spack stack setup-meta-modules extension to work correctly with chained environments
• Bug fixes for Nautilus, Derecho, Hercules
• Alternative gcc@12.2.0 + openmpi@4.1.6 software stack on Hercules (in addition to the default gcc@12.2.0 + mvapich2@2.3.7 stack) that seems to address the random errors of MPI programs of the default GNU stack

Version 1.5.1

V1.5.1 is a minor update of V1.5.0 with new library versions for NOAA's Unified Forecast System (UFS) and JCSDA's Joint Effort for Data assimilation Integration (JEDI).

The spack-stack package is a collaborative effort between the NOAA Environmental Modeling Center (EMC), the UCAR Joint Center for Satellite Data Assimilation (JCSDA), and the Earth Prediction Innovation Center (EPIC). spack-stack is designed to support the various applications of the supporting agencies such as the Unified Forecast System (UFS) or the Joint Effort for Data assimilation Integration (JEDI).

Documentation for installing and using spack-stack can be found here: https://spack-stack.readthedocs.io/en/1.5.1/

New This Release

This is a minor update on top of V1.5.0:

• Update of Hercules site config for GNU compiler to fix issues with the Unified Forecast System due to a bug in gcc@11 (move to gcc@12)
• Update of bufr to 12.0.1
• Update of ecmwf-atlas to 0.35.0, enabling tesselation features
• Update fms to 2023.02.01, addition of version 2023.03
• Update of esmf to 8.5.0, mapl to 2.40.3, and update of mapl dependencies
• Update of gsi-ncdiag to 1.1.2
• Bug fix for py-pandas / py-openpyxl
• Various smaller site configuration updates (Python with/without ssl enabled) to fix openssh/openssl library version mismatches

Version 1.5.0

We are pleased to announce the release of V1.5.0 of spack-stack.

The spack-stack package is a collaborative effort between the NOAA Environmental Modeling Center (EMC), the UCAR Joint Center for Satellite Data Assimilation (JCSDA), and the Earth Prediction Innovation Center (EPIC). spack-stack is designed to support the various applications of the supporting agencies such as the Unified Forecast System (UFS) or the Joint Effort for Data assimilation Integration (JEDI).

Documentation for installing and using spack-stack can be found here: https://spack-stack.readthedocs.io/en/1.5.0/

New This Release

• Support for MSU Hercules, NOAA RDHPCS Gaea C5, NCAR-Wyoming Derecho
• Major update from spack authoritative repository to 0.21.0.dev0
• Use of C++-17 in boost and in several new versions of ECMWF libraries (eckit, fckit, ecmwf-atlas, ...)
• The Python version used by downstream applications of spack-stack is now built by spack (no longer an external package) for most platforms
• Additional CI tests, in particular on macOS M1
• Utility to check for duplicates after concretization
• Utility to check user umask when creating environments
• Fixed several bugs in spack stack setup-meta-modules
• Numerous version updates and bug fixes for packages in the unified environment, including a critical bug fix to scotch (version 7.0.4) and an update of NCEPLIBS-bufr to 12.0.0
• Additional packages for working with cloud resources (awscli, globus-cli)
• Static build options for packages required by the UFS Weather Model for installation on NCO's operational systems

Version 1.4.1

V1.4.1 is a bug fix release specifically for enabling the transition of NOAA's Unified Forecast System (UFS) to spack-stack.

The spack-stack package is a collaborative effort between the NOAA Environmental Modeling Center (EMC), the UCAR Joint Center for Satellite Data Assimilation (JCSDA), and the Earth Prediction Innovation Center (EPIC). spack-stack is designed to support the various applications of the supporting agencies such as the Unified Forecast System (UFS) or the Joint Effort for Data assimilation Integration (JEDI).

Documentation for installing and using spack-stack can be found here: https://spack-stack.readthedocs.io/en/1.4.1/

New This Release

This is a bug fix release on top of V1.4.0:

• Bug fix for the scotch library required for coupled UFS configurations
• Update of bufr from 11.7.1 to 1.12.0
• Update of eckit from 1.23.0 to 1.23.1
• Update of Hercules and Gaea C5 site configurations

Version 1.4.0

We are pleased to announce the release of V1.4.0 of spack-stack.

The spack-stack package is a collaborative effort between the NOAA Environmental Modeling Center (EMC), the UCAR Joint Center for Satellite Data Assimilation (JCSDA), and the Earth Prediction Innovation Center (EPIC). spack-stack is designed to support the various applications of the supporting agencies such as the Unified Forecast System (UFS) or the Joint Effort for Data assimilation Integration (JEDI).

Documentation for installing and using spack-stack can be found here: https://spack-stack.readthedocs.io/en/1.4.0/

New This Release

• Support for the Navy Nautilus HPC
• Experimental support for MSU's Hercules and NOAA's Gaea C5
• Addition of jedi-neptune-env
• Addition of scotch to ufs-weather-model-env
• Update hdf5 and py-h5py to 1.14.0 and 3.7.0
• Major update from spack authoritative repository to a version close to the recently released spack v0.20.0
• Several small bug fixes and updates

Known Issues

• Build error: mapl 2.35.2 does not build on the Navy Narwhal HPC, therefore removed ufs-weather-model-env and jedi-ufs-env from that system
• GNU environment on S4 currently not supported, because new HDF5 version requires newer MPI library than currently available (mpich-4.0.1); newer mpich versions cannot build mapl 2.35.2.
• Substituted wgrib2 2.0.8 with 3.1.1 on Hercules and Nautilus

Version 1.3.1

V1.3.1 is an internal bug fix release required for specific uses cases that have problems with hdf5@1.14.0 (JEDI-Skylab, GSI).

The spack-stack package is a collaborative effort between the NOAA Environmental Modeling Center (EMC), the UCAR Joint Center for Satellite Data Assimilation (JCSDA), and the Earth Prediction Innovation Center (EPIC). spack-stack is designed to support the various applications of the supporting agencies such as the Unified Forecast System (UFS) or the Joint Effort for Data assimilation Integration (JEDI).

Documentation for installing and using spack-stack can be found here: https://spack-stack.readthedocs.io/en/1.3.1/

New This Release

This is a bug fix release on top of V1.3.0:

• Downgrade hdf5 from 1.14.0 to 1.12.2 and py-h5py from 3.7.0 to 3.6.0
• New versions of eckit, fckit, ecmf-atlas, crtm, odc, gsibec, crtm
• Add missing jedi-mpas-env to unified environment
• Remove ufs-weather-model~debug from several templates

Version 1.3.0

We are pleased to announce the release of V1.3.0 of spack-stack.

The spack-stack package is a collaborative effort between the NOAA Environmental Modeling Center (EMC), the UCAR Joint Center for Satellite Data Assimilation (JCSDA), and the Earth Prediction Innovation Center (EPIC). spack-stack is designed to support the various applications of the supporting agencies such as the Unified Forecast System (UFS) or the Joint Effort for Data assimilation Integration (JEDI).

Documentation for installing and using spack-stack can be found here: https://spack-stack.readthedocs.io/en/1.3.0/

New This Release

• New unified environment (using template unified-dev) with support for compiler matrices (install for multiple compilers in same environment) that can be used for JEDI and UFS applications (ufs-weather-model, ufs-srweather-app, global-workflow except GSI)
• New versions of eckit, ecmwf-atlas, ectrans, esmf, fckit, fms, gsibec, hdf5, mapl, netcdf-c, netcdf-fortran, parallelio
• For user platforms and CI systems, always build Python with spack, do not use externally supplied Python
• For HPCs using external Python, also use external py-pip
• Add option to comple wiht NCO IT FISMA high requirements for ecbuild, eckit, fckit, ecmwf-atlas, yafyaml
• Support for additional platforms (Narwhal with GNU, NOAA ParallelWorks, AWS Parallel Cluster)
• Reorganization of documenation
• Hardening of CI system, now running on Github self-hosted runners on AWS EC2
• Support for Apple M2 CPUs

For more details about this release, see https://github.com/orgs/NOAA-EMC/projects/11.

Version 1.2.0

We are pleased to announce the release of V1.2.0 of spack-stack.

The spack-stack package is a collaborative effort between the NOAA Environmental Modeling Center (EMC), the UCAR Joint Center for Satellite Data Assimilation (JCSDA), and the Earth Prediction Innovation Center (EPIC). spack-stack is designed to support the various applications of the supporting agencies such as the Unified Forecast System (UFS) or the Joint Effort for Data assimilation Integration (JEDI).

Documentation for installing and using spack-stack can be found here: https://spack-stack.readthedocs.io/en/1.2.0/

New This Release

• Use of spack mirrors (source caches) on all preconfigured platforms
• Update of spack to 0.20.0.dev0
• Support for building spack-stack on Apple M1 natively (arch64)
• Numerous package updates (eckit, fiat, ectrans, ecmwf-atlas, gsibec, crtm, netcdf-c, netcdf-fortran, ...)
• Additional supported platforms: NCAR-Wyoming Casper with Intel, UW S4 with GNU, initial site config for Navy's Narwhal system
• Numerous bug fixes in packages (compiler flags, met on macOS ...)
• Bug fix for using rpath on macOS
• Python 3.10 support

For more details about this release, see https://github.com/orgs/NOAA-EMC/projects/10.