Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

move LD_LIBRARY_PATH patch to load_ufsda_modules.sh #3232

Closed
RussTreadon-NOAA opened this issue Jan 15, 2025 · 2 comments · Fixed by #3236
Closed

move LD_LIBRARY_PATH patch to load_ufsda_modules.sh #3232

RussTreadon-NOAA opened this issue Jan 15, 2025 · 2 comments · Fixed by #3236
Assignees
@RussTreadon-NOAA
Labels
feature New feature or request triage Issues that are triage

Comments

@RussTreadon-NOAA
Copy link
Contributor

What new functionality do you need?

@aerorahul suggested in #3229 moving the LD_LIBRARY_PATH patch added to env/WCOSS2.env by #3220 to the WCOSS2 block in ush/load_ufsda_modules.sh.

This issue is opened to explore this idea.

What are the requirements for the new functionality?

Apply the WCOSS2 LD_LIBRARY_PATH patch only to g-w jobs executing GDASApp applications.

Acceptance Criteria

  • WCOSS2 g-w CI passes for all cases currently active on WCOSS2
  • ensure changes do not adversely impact other machines (sanity check of g-w CI on Hera, Hercules, or Orion)

Suggest a solution (optional)

Add the following lines to ush/load_ufsda_modules.sh

--- a/ush/load_ufsda_modules.sh
+++ b/ush/load_ufsda_modules.sh
@@ -38,6 +38,10 @@ case "${MACHINE_ID}" in
     #TODO: Remove LMOD_TMOD_FIND_FIRST line when spack-stack on WCOSS2
     if [[ "${MACHINE_ID}" == "wcoss2" ]]; then
       export LMOD_TMOD_FIND_FIRST=yes
+      # TODO: Add path to GDASApp libraries and cray-mpich as temporary patches
+      # TODO: Remove LD_LIBRARY_PATH lines as soon as permanent solutions are available
+      export LD_LIBRARY_PATH="${LD_LIBRARY_PATH}:${HOMEgfs}/sorc/gdas.cd/build/lib"
+      export LD_LIBRARY_PATH="${LD_LIBRARY_PATH}:/opt/cray/pe/mpich/8.1.19/ofi/intel/19.0/lib"
     fi
     module load "${MODS}/${MACHINE_ID}"
     ncdump=$( command -v ncdump )
@RussTreadon-NOAA RussTreadon-NOAA added feature New feature or request triage Issues that are triage labels Jan 15, 2025
@RussTreadon-NOAA RussTreadon-NOAA self-assigned this Jan 15, 2025
@RussTreadon-NOAA
Copy link
Contributor Author

Work for this issue will be done in RussTreadon-NOAA:global-workflow/feature/ld_library_path

RussTreadon-NOAA added a commit to RussTreadon-NOAA/global-workflow that referenced this issue Jan 15, 2025
@RussTreadon-NOAA
move WCOSS2 LD_LIBRARY_PATH patches to load_ufsda_modules.sh (NOAA-EM…
a43365a 
…C#3232)
@RussTreadon-NOAA
Copy link
Contributor Author

g-w CI

Install feature/ld_library_path at a43365a on WCOSS2 (Cactus), Hera, and Orion.

Run g-w CI with the following results:

WCOSS2 (Cactus)

/lfs/h2/emc/ptmp/russ.treadon/EXPDIR/C48_ATM_test
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103231200        Done    Jan 15 2025 20:40:30    Jan 15 2025 22:05:21
202103231800        Done    Jan 15 2025 20:40:30    Jan 15 2025 22:15:30
 
/lfs/h2/emc/ptmp/russ.treadon/EXPDIR/C48mx500_3DVarAOWCDA_test
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103241800        Done    Jan 15 2025 20:40:32    Jan 15 2025 21:00:23
202103250000        Done    Jan 15 2025 20:40:32    Jan 15 2025 22:35:23
 
/lfs/h2/emc/ptmp/russ.treadon/EXPDIR/C48mx500_hybAOWCDA_test
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103241800        Done    Jan 15 2025 20:40:34    Jan 15 2025 21:00:27
202103250000        Done    Jan 15 2025 20:40:34    Jan 15 2025 22:40:45
 
/lfs/h2/emc/ptmp/russ.treadon/EXPDIR/C48_S2SWA_gefs_test
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103231200        Done    Jan 15 2025 20:40:47    Jan 15 2025 22:55:44
 
/lfs/h2/emc/ptmp/russ.treadon/EXPDIR/C48_S2SW_test
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103231200        Done    Jan 15 2025 20:40:36    Jan 15 2025 22:25:30
202103231800        Done    Jan 15 2025 20:40:36    Jan 15 2025 22:35:32
 
/lfs/h2/emc/ptmp/russ.treadon/EXPDIR/C96_atm3DVar_test
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201800        Done    Jan 15 2025 20:40:38    Jan 15 2025 21:05:39
202112210000        Done    Jan 15 2025 20:40:38    Jan 15 2025 23:45:37
202112210600        Done    Jan 15 2025 20:40:38    Jan 15 2025 23:25:30
 
/lfs/h2/emc/ptmp/russ.treadon/EXPDIR/C96C48_hybatmaerosnowDA_test
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201200        Done    Jan 15 2025 20:40:41    Jan 15 2025 21:10:45
202112201800        Done    Jan 15 2025 20:40:41    Jan 15 2025 23:45:41
202112210000        Done    Jan 15 2025 20:40:41    Jan 15 2025 23:30:46
 
/lfs/h2/emc/ptmp/russ.treadon/EXPDIR/C96C48_hybatmDA_test
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201800        Done    Jan 15 2025 20:40:43    Jan 15 2025 21:05:46
202112210000        Done    Jan 15 2025 20:40:43    Jan 15 2025 23:50:48
202112210600        Done    Jan 15 2025 20:40:43    Jan 15 2025 23:35:38
 
/lfs/h2/emc/ptmp/russ.treadon/EXPDIR/C96C48_ufs_hybatmDA_test
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202402231800        Done    Jan 15 2025 20:40:45    Jan 15 2025 21:05:51
202402240000        Done    Jan 15 2025 20:40:45    Jan 16 2025 00:15:42
202402240600        Done    Jan 15 2025 20:40:45    Jan 16 2025 00:20:48
 
/lfs/h2/emc/ptmp/russ.treadon/EXPDIR/C96_S2SWA_gefs_replay_ics_test
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202011010000        Done    Jan 15 2025 20:40:49    Jan 15 2025 22:21:10

Hera

/scratch1/NCEPDEV/stmp2/Russ.Treadon/EXPDIR/C48_ATM_test
   CYCLE         STATE           ACTIVATED              DEACTIVATED
202103231200        Done    Jan 15 2025 20:31:25    Jan 15 2025 21:50:19
202103231800        Done    Jan 15 2025 20:31:25    Jan 15 2025 22:00:33

/scratch1/NCEPDEV/stmp2/Russ.Treadon/EXPDIR/C48_S2SW_test
   CYCLE         STATE           ACTIVATED              DEACTIVATED
202103231200        Done    Jan 15 2025 20:31:27    Jan 15 2025 23:35:19
202103231800        Done    Jan 15 2025 20:31:27    Jan 15 2025 23:45:27

/scratch1/NCEPDEV/stmp2/Russ.Treadon/EXPDIR/C48_S2SWA_gefs_test
   CYCLE         STATE           ACTIVATED              DEACTIVATED
202103231200        Done    Jan 15 2025 20:31:28    Jan 15 2025 23:15:21

/scratch1/NCEPDEV/stmp2/Russ.Treadon/EXPDIR/C48mx500_3DVarAOWCDA_test
   CYCLE         STATE           ACTIVATED              DEACTIVATED
202103241800        Done    Jan 15 2025 20:31:30    Jan 15 2025 20:50:25
202103250000        Done    Jan 15 2025 20:31:30    Jan 15 2025 21:55:19

/scratch1/NCEPDEV/stmp2/Russ.Treadon/EXPDIR/C48mx500_hybAOWCDA_test
   CYCLE         STATE           ACTIVATED              DEACTIVATED
202103241800        Done    Jan 15 2025 20:31:31    Jan 15 2025 20:50:27
202103250000        Done    Jan 15 2025 20:31:31    Jan 15 2025 21:55:21

/scratch1/NCEPDEV/stmp2/Russ.Treadon/EXPDIR/C96C48_hybatmDA_test
   CYCLE         STATE           ACTIVATED              DEACTIVATED
202112201800        Done    Jan 15 2025 20:31:33    Jan 15 2025 20:50:29
202112210000        Done    Jan 15 2025 20:31:33    Jan 15 2025 23:15:27
202112210600        Done    Jan 15 2025 20:31:33    Jan 15 2025 22:55:21

/scratch1/NCEPDEV/stmp2/Russ.Treadon/EXPDIR/C96C48_hybatmaerosnowDA_test
   CYCLE         STATE           ACTIVATED              DEACTIVATED
202112201200        Done    Jan 15 2025 20:31:34    Jan 15 2025 20:55:23
202112201800        Done    Jan 15 2025 20:31:34    Jan 15 2025 23:15:28
202112210000        Done    Jan 15 2025 20:31:34    Jan 15 2025 23:00:32

/scratch1/NCEPDEV/stmp2/Russ.Treadon/EXPDIR/C96C48_ufs_hybatmDA_test
   CYCLE         STATE           ACTIVATED              DEACTIVATED
202402231800        Done    Jan 15 2025 20:31:36    Jan 15 2025 20:50:34
202402240000        Done    Jan 15 2025 20:31:36    Jan 16 2025 00:02:03
202402240600        Done    Jan 15 2025 20:31:36    Jan 15 2025 23:45:39

/scratch1/NCEPDEV/stmp2/Russ.Treadon/EXPDIR/C96_S2SWA_gefs_replay_ics_test
   CYCLE         STATE           ACTIVATED              DEACTIVATED
202011010000        Done    Jan 15 2025 20:31:38    Jan 15 2025 21:55:27

/scratch1/NCEPDEV/stmp2/Russ.Treadon/EXPDIR/C96_atm3DVar_test
   CYCLE         STATE           ACTIVATED              DEACTIVATED
202112201800        Done    Jan 15 2025 20:31:39    Jan 15 2025 20:50:38
202112210000        Done    Jan 15 2025 20:31:39    Jan 15 2025 23:25:29
202112210600        Done    Jan 15 2025 20:31:39    Jan 15 2025 22:50:34

Orion

/work2/noaa/stmp/rtreadon/ORION/EXPDIR/C48_ATM_test
   CYCLE         STATE           ACTIVATED              DEACTIVATED
202103231200        Done    Jan 15 2025 21:51:50    Jan 15 2025 23:25:05
202103231800        Done    Jan 15 2025 21:51:50    Jan 15 2025 23:45:04

/work2/noaa/stmp/rtreadon/ORION/EXPDIR/C48mx500_3DVarAOWCDA_test
   CYCLE         STATE           ACTIVATED              DEACTIVATED
202103241800        Done    Jan 15 2025 21:51:51    Jan 15 2025 22:15:08
202103250000        Done    Jan 15 2025 21:51:51    Jan 15 2025 23:45:06

/work2/noaa/stmp/rtreadon/ORION/EXPDIR/C48mx500_hybAOWCDA_test
   CYCLE         STATE           ACTIVATED              DEACTIVATED
202103241800        Done    Jan 15 2025 21:51:53    Jan 15 2025 22:15:10
202103250000        Done    Jan 15 2025 21:51:53    Jan 15 2025 23:55:07

/work2/noaa/stmp/rtreadon/ORION/EXPDIR/C48_S2SWA_gefs_test
   CYCLE         STATE           ACTIVATED              DEACTIVATED
202103231200        Done    Jan 15 2025 21:51:55    Jan 16 2025 01:14:22

SKIP C48_S2SW_extended on hera

/work2/noaa/stmp/rtreadon/ORION/EXPDIR/C48_S2SW_test
   CYCLE         STATE           ACTIVATED              DEACTIVATED
202103231200        Done    Jan 15 2025 21:51:57    Jan 16 2025 01:15:11
202103231800        Done    Jan 15 2025 21:51:57    Jan 16 2025 01:30:10

/work2/noaa/stmp/rtreadon/ORION/EXPDIR/C96_atm3DVar_test
   CYCLE         STATE           ACTIVATED              DEACTIVATED
202112201800        Done    Jan 15 2025 21:51:59    Jan 15 2025 22:20:14
202112210000        Done    Jan 15 2025 21:51:59    Jan 16 2025 01:28:41
202112210600        Done    Jan 15 2025 21:51:59    Jan 16 2025 01:10:11

/work2/noaa/stmp/rtreadon/ORION/EXPDIR/C96C48_hybatmaerosnowDA_test
   CYCLE         STATE           ACTIVATED              DEACTIVATED
202112201200        Done    Jan 15 2025 21:52:01    Jan 15 2025 22:25:13
202112201800        Done    Jan 15 2025 21:52:01    Jan 16 2025 01:15:14
202112210000        Done    Jan 15 2025 21:52:01    Jan 16 2025 01:15:14

/work2/noaa/stmp/rtreadon/ORION/EXPDIR/C96C48_hybatmDA_test
   CYCLE         STATE           ACTIVATED              DEACTIVATED
202112201800        Done    Jan 15 2025 21:52:03    Jan 15 2025 22:20:18
202112210000        Done    Jan 15 2025 21:52:03    Jan 16 2025 01:28:45
202112210600        Done    Jan 15 2025 21:52:03    Jan 16 2025 01:20:16

/work2/noaa/stmp/rtreadon/ORION/EXPDIR/C96C48_ufs_hybatmDA_test
   CYCLE         STATE           ACTIVATED              DEACTIVATED
202402231800        Done    Jan 15 2025 21:52:04    Jan 15 2025 22:25:17
202402240000        Done    Jan 15 2025 21:52:04    Jan 16 2025 02:28:13
202402240600        Done    Jan 15 2025 21:52:04    Jan 16 2025 03:00:17

/work2/noaa/stmp/rtreadon/ORION/EXPDIR/C96_S2SWA_gefs_replay_ics_test
   CYCLE         STATE           ACTIVATED              DEACTIVATED
202011010000        Done    Jan 15 2025 21:52:06    Jan 16 2025 00:05:20

All jobs in all streams successfully ran to completion on Cactus, Hera, and Orion.

@RussTreadon-NOAA RussTreadon-NOAA mentioned this issue Jan 16, 2025
Merged
7 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@RussTreadon-NOAA RussTreadon-NOAA

Labels
feature New feature or request triage Issues that are triage
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Move WCOSS2 LD_LIBRARY_PATH patches to load_ufsda_modules.sh RussTreadon-NOAA/global-workflow
1 participant
@RussTreadon-NOAA