Skip to content

Enable native AWS #3244

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
FernandoAndrade-NOAA merged 56 commits into from
Jun 5, 2026
Merged

Enable native AWS #3244

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
56 commits
Select commit Hold shift + click to select a range
b387dfc
replace zlib-ng with zlib
weihuang-jedi Mar 11, 2026
f7fc2d6
Merge branch 'ufs-community:develop' into feature/on-aws-ec2
weihuang-jedi Mar 12, 2026
a34f391
add aws-ec2
weihuang-jedi Apr 14, 2026
2ec2282
on aws-ec2
weihuang-jedi Apr 16, 2026
34f7290
sync with ufs repo
weihuang-jedi Apr 16, 2026
ab2b4b1
Merge branch 'ufs-community:develop' into feature/on-aws-ec2
weihuang-jedi Apr 21, 2026
cef2313
Removing hard coded baseline date.
kbooker79 Apr 30, 2026
792f745
Merge branch 'develop' into chore/fix-hardcoded-bl-date
kbooker79 Apr 30, 2026
acc00b1
Update FAQ.rst
selbigmtnwx23 May 1, 2026
b7b5b18
Update FAQ.rst
selbigmtnwx23 May 1, 2026
2043560
Update FAQ.rst
selbigmtnwx23 May 1, 2026
d342e12
Merge branch 'develop' into chore/fix-hardcoded-bl-date
gspetro-NOAA May 7, 2026
a31c31a
Merge branch 'develop' into feature/on-aws-ec2
gspetro-NOAA May 7, 2026
fa14d87
Update tests/detect_machine.sh to remove frontera
weihuang-jedi May 7, 2026
e522df9
Update doc/UsersGuide/source/FAQ.rst
selbigmtnwx23 May 7, 2026
3ec0657
Update doc/UsersGuide/source/FAQ.rst
selbigmtnwx23 May 7, 2026
70695c3
Update doc/UsersGuide/source/FAQ.rst
selbigmtnwx23 May 7, 2026
de799eb
Merge branch 'chore/fix-hardcoded-bl-date' of https://github.com/kboo…
gspetro-NOAA May 8, 2026
4b31dad
Update FAQ.rst
selbigmtnwx23 May 8, 2026
aa4a6fe
Merge branch 'ufs-community:develop' into develop
selbigmtnwx23 May 8, 2026
fef4350
Update doc/UsersGuide/source/FAQ.rst
selbigmtnwx23 May 8, 2026
4c6f732
Update doc/UsersGuide/source/FAQ.rst
selbigmtnwx23 May 8, 2026
c1faf3c
Update doc/UsersGuide/source/FAQ.rst
selbigmtnwx23 May 8, 2026
0f21472
Merge branch 'develop' of https://github.com/selbigmtnwx23/ufs-weathe…
gspetro-NOAA May 8, 2026
f7bd3ab
update LM4-driver hash
gspetro-NOAA May 8, 2026
a02b912
update datm_cdeps_lm4 tests to run on ursa
gspetro-NOAA May 8, 2026
e1187a9
hercules rt log
gspetro-NOAA May 8, 2026
3f6111b
ursa rt log & test_changes.list
gspetro-NOAA May 9, 2026
13fa3a7
update ursa rt log & test_changes.list
gspetro-NOAA May 11, 2026
98f7c37
Merge branch 'feature/lm4' into feature/on-aws-ec2
gspetro-NOAA May 11, 2026
77bfd2d
Merge branch 'develop' into feature/on-aws-ec2
gspetro-NOAA May 11, 2026
a48beac
WCOSS2 RT Log: passed
BrianCurtis-NOAA May 11, 2026
07ce282
orion rt logs - passed
gspetro-NOAA May 12, 2026
7dee482
hercules rt log - passed
gspetro-NOAA May 12, 2026
a3b1aec
Merge branch 'feature/on-aws-ec2' of github.com:NOAA-EPIC/ufs-weather…
BrianCurtis-NOAA May 12, 2026
a3e6276
Acorn RT Log: passed
BrianCurtis-NOAA May 12, 2026
2f94e0e
add ursa RT and ORT logs passed
FernandoAndrade-NOAA May 12, 2026
5300200
add gaeaC6 RT log passed
FernandoAndrade-NOAA May 13, 2026
c9dec80
Update UFSATM to temp repo
WalterKolczynski-NOAA May 16, 2026
2327b04
Merge branch 'develop' into feature/on-aws-ec2
WalterKolczynski-NOAA May 16, 2026
4067ff6
Update UFSATM with updated develop
WalterKolczynski-NOAA May 26, 2026
f4575cd
Merge branch 'develop' into feature/on-aws-ec2
WalterKolczynski-NOAA May 27, 2026
3ea89bc
RT tests on Ursa
WalterKolczynski-NOAA May 28, 2026
a53c691
Merge branch 'develop' into feature/on-aws-ec2
WalterKolczynski-NOAA May 28, 2026
ab4ca85
Merge branch 'develop' into feature/on-aws-ec2
WalterKolczynski-NOAA Jun 3, 2026
1084776
Merge in UFSATM develop
WalterKolczynski-NOAA Jun 3, 2026
19c1e39
ORT Jobs Completed.
epic-cicd-jenkins Jun 3, 2026
7a96c76
hercules rt log - passed
gspetro-NOAA Jun 4, 2026
abad395
orion rt log - passed
gspetro-NOAA Jun 4, 2026
a60bd04
WCOSS2 RT Log: Passed
BrianCurtis-NOAA Jun 4, 2026
67f4945
add gaeaC6 RT log passed
FernandoAndrade-NOAA Jun 4, 2026
21a4b27
add ursa RT log passed
FernandoAndrade-NOAA Jun 4, 2026
c72e106
Acorn RT Log: passed
BrianCurtis-NOAA Jun 4, 2026
a757e4b
derecho rt log - verify
gspetro-NOAA Jun 4, 2026
aff5113
Merge branch 'feature/on-aws-ec2' of https://github.com/NOAA-EPIC/ufs…
gspetro-NOAA Jun 4, 2026
fd98865
Bump UFSATM to merged version on auth repo
WalterKolczynski-NOAA Jun 5, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion UFSATM
Open in desktop
Submodule UFSATM updated 2 files
+1 −0 CMakeLists.txt
+1 −1 upp
1 change: 1 addition & 0 deletions cmake/configure_aws-ec2.intel.cmake
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
set(PARALLEL_NETCDF ON CACHE BOOL "Enable parallel NetCDF" FORCE)
48 changes: 24 additions & 24 deletions tests/logs/OpnReqTests_control_p8_ursa.log
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,9 +1,9 @@
Mon Jun 1 21:14:08 UTC 2026
Wed Jun 3 21:03:30 UTC 2026
Start Operation Requirement Test


baseline dir = /scratch3/NCEPDEV/stmp/role.epic/ORT-stmp/role.epic/FV3_OPNREQ_TEST/OPNREQ_TEST/control_p8_bit_base_intel
working dir = /scratch3/NCEPDEV/stmp/role.epic/ORT-ptmp/role.epic/FV3_OPNREQ_TEST/opnReqTest_3391669/bit_base_bit_base
working dir = /scratch3/NCEPDEV/stmp/role.epic/ORT-ptmp/role.epic/FV3_OPNREQ_TEST/opnReqTest_1787486/bit_base_bit_base
Checking test bit_base results ....
Moving baseline bit_base files ....
Moving sfcf000.nc .........OK
Expand Down Expand Up @@ -51,14 +51,14 @@ Moving baseline bit_base files ....
Moving RESTART/20210323.060000.sfc_data.tile5.nc .........OK
Moving RESTART/20210323.060000.sfc_data.tile6.nc .........OK

0: The total amount of wall time = 146.365648
0: The maximum resident set size (KB) = 2622764
0: The total amount of wall time = 525.386835
0: The maximum resident set size (KB) = 2627092

Test bit_base PASS


baseline dir = /scratch3/NCEPDEV/stmp/role.epic/ORT-stmp/role.epic/FV3_OPNREQ_TEST/OPNREQ_TEST/control_p8_dbg_base_intel
working dir = /scratch3/NCEPDEV/stmp/role.epic/ORT-ptmp/role.epic/FV3_OPNREQ_TEST/opnReqTest_3391669/dbg_base_dbg_base
working dir = /scratch3/NCEPDEV/stmp/role.epic/ORT-ptmp/role.epic/FV3_OPNREQ_TEST/opnReqTest_1787486/dbg_base_dbg_base
Checking test dbg_base results ....
Moving baseline dbg_base files ....
Moving sfcf000.nc .........OK
Expand Down Expand Up @@ -106,14 +106,14 @@ Moving baseline dbg_base files ....
Moving RESTART/20210323.060000.sfc_data.tile5.nc .........OK
Moving RESTART/20210323.060000.sfc_data.tile6.nc .........OK

0: The total amount of wall time = 1245.712478
0: The maximum resident set size (KB) = 2544108
0: The total amount of wall time = 1241.080662
0: The maximum resident set size (KB) = 2531592

Test dbg_base PASS


baseline dir = /scratch3/NCEPDEV/stmp/role.epic/ORT-stmp/role.epic/FV3_OPNREQ_TEST/OPNREQ_TEST/control_p8_std_base_intel
working dir = /scratch3/NCEPDEV/stmp/role.epic/ORT-ptmp/role.epic/FV3_OPNREQ_TEST/opnReqTest_3391669/dcp_dcp
working dir = /scratch3/NCEPDEV/stmp/role.epic/ORT-ptmp/role.epic/FV3_OPNREQ_TEST/opnReqTest_1787486/dcp_dcp
Checking test dcp results ....
Comparing sfcf000.nc .....USING NCCMP......OK
Comparing sfcf021.nc .....USING NCCMP......OK
Expand Down Expand Up @@ -160,14 +160,14 @@ Checking test dcp results ....
Comparing RESTART/20210323.060000.sfc_data.tile5.nc .....USING NCCMP......OK
Comparing RESTART/20210323.060000.sfc_data.tile6.nc .....USING NCCMP......OK

0: The total amount of wall time = 739.249434
0: The maximum resident set size (KB) = 2530832
0: The total amount of wall time = 658.765605
0: The maximum resident set size (KB) = 2521144

Test dcp PASS


baseline dir = /scratch3/NCEPDEV/stmp/role.epic/ORT-stmp/role.epic/FV3_OPNREQ_TEST/OPNREQ_TEST/control_p8_std_base_intel
working dir = /scratch3/NCEPDEV/stmp/role.epic/ORT-ptmp/role.epic/FV3_OPNREQ_TEST/opnReqTest_3391669/mpi_mpi
working dir = /scratch3/NCEPDEV/stmp/role.epic/ORT-ptmp/role.epic/FV3_OPNREQ_TEST/opnReqTest_1787486/mpi_mpi
Checking test mpi results ....
Comparing sfcf000.nc .....USING NCCMP......OK
Comparing sfcf021.nc .....USING NCCMP......OK
Expand Down Expand Up @@ -214,14 +214,14 @@ Checking test mpi results ....
Comparing RESTART/20210323.060000.sfc_data.tile5.nc .....USING NCCMP......OK
Comparing RESTART/20210323.060000.sfc_data.tile6.nc .....USING NCCMP......OK

0: The total amount of wall time = 119.600522
0: The maximum resident set size (KB) = 2512556
0: The total amount of wall time = 520.090561
0: The maximum resident set size (KB) = 2518820

Test mpi PASS


baseline dir = /scratch3/NCEPDEV/stmp/role.epic/ORT-stmp/role.epic/FV3_OPNREQ_TEST/OPNREQ_TEST/control_p8_std_base_intel
working dir = /scratch3/NCEPDEV/stmp/role.epic/ORT-ptmp/role.epic/FV3_OPNREQ_TEST/opnReqTest_3391669/rst_rst
working dir = /scratch3/NCEPDEV/stmp/role.epic/ORT-ptmp/role.epic/FV3_OPNREQ_TEST/opnReqTest_1787486/rst_rst
Checking test rst results ....
Comparing sfcf000.nc .....USING NCCMP......OK
Comparing sfcf021.nc .....USING NCCMP......OK
Expand Down Expand Up @@ -268,14 +268,14 @@ Checking test rst results ....
Comparing RESTART/20210323.060000.sfc_data.tile5.nc .....USING NCCMP......OK
Comparing RESTART/20210323.060000.sfc_data.tile6.nc .....USING NCCMP......OK

0: The total amount of wall time = 795.216687
0: The maximum resident set size (KB) = 2533696
0: The total amount of wall time = 532.089508
0: The maximum resident set size (KB) = 2522340

Test rst PASS


baseline dir = /scratch3/NCEPDEV/stmp/role.epic/ORT-stmp/role.epic/FV3_OPNREQ_TEST/OPNREQ_TEST/control_p8_std_base_intel
working dir = /scratch3/NCEPDEV/stmp/role.epic/ORT-ptmp/role.epic/FV3_OPNREQ_TEST/opnReqTest_3391669/std_base_std_base
working dir = /scratch3/NCEPDEV/stmp/role.epic/ORT-ptmp/role.epic/FV3_OPNREQ_TEST/opnReqTest_1787486/std_base_std_base
Checking test std_base results ....
Moving baseline std_base files ....
Moving sfcf000.nc .........OK
Expand Down Expand Up @@ -323,14 +323,14 @@ Moving baseline std_base files ....
Moving RESTART/20210323.060000.sfc_data.tile5.nc .........OK
Moving RESTART/20210323.060000.sfc_data.tile6.nc .........OK

0: The total amount of wall time = 124.138427
0: The maximum resident set size (KB) = 2524808
0: The total amount of wall time = 119.686979
0: The maximum resident set size (KB) = 2505800

Test std_base PASS


baseline dir = /scratch3/NCEPDEV/stmp/role.epic/ORT-stmp/role.epic/FV3_OPNREQ_TEST/OPNREQ_TEST/control_p8_std_base_intel
working dir = /scratch3/NCEPDEV/stmp/role.epic/ORT-ptmp/role.epic/FV3_OPNREQ_TEST/opnReqTest_3391669/thr_thr
working dir = /scratch3/NCEPDEV/stmp/role.epic/ORT-ptmp/role.epic/FV3_OPNREQ_TEST/opnReqTest_1787486/thr_thr
Checking test thr results ....
Comparing sfcf000.nc .....USING NCCMP......OK
Comparing sfcf021.nc .....USING NCCMP......OK
Expand Down Expand Up @@ -377,11 +377,11 @@ Checking test thr results ....
Comparing RESTART/20210323.060000.sfc_data.tile5.nc .....USING NCCMP......OK
Comparing RESTART/20210323.060000.sfc_data.tile6.nc .....USING NCCMP......OK

0: The total amount of wall time = 525.614060
0: The maximum resident set size (KB) = 2526448
0: The total amount of wall time = 651.762270
0: The maximum resident set size (KB) = 2512780

Test thr PASS

OPERATION REQUIREMENT TEST WAS SUCCESSFUL
Mon Jun 1 23:03:36 UTC 2026
Elapsed time: 01h:49m:28s. Have a nice day!
Wed Jun 3 23:16:12 UTC 2026
Elapsed time: 02h:12m:42s. Have a nice day!
30 changes: 15 additions & 15 deletions tests/logs/OpnReqTests_regional_control_ursa.log
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,9 +1,9 @@
Mon Jun 1 21:14:09 UTC 2026
Wed Jun 3 21:03:30 UTC 2026
Start Operation Requirement Test


baseline dir = /scratch3/NCEPDEV/stmp/role.epic/ORT-stmp/role.epic/FV3_OPNREQ_TEST/OPNREQ_TEST/regional_control_bit_base_intel
working dir = /scratch3/NCEPDEV/stmp/role.epic/ORT-ptmp/role.epic/FV3_OPNREQ_TEST/opnReqTest_3392042/bit_base_bit_base
working dir = /scratch3/NCEPDEV/stmp/role.epic/ORT-ptmp/role.epic/FV3_OPNREQ_TEST/opnReqTest_1787321/bit_base_bit_base
Checking test bit_base results ....
Moving baseline bit_base files ....
Moving dynf000.nc .........OK
Expand All @@ -15,14 +15,14 @@ Moving baseline bit_base files ....
Moving NATLEV.GrbF00 .........OK
Moving NATLEV.GrbF06 .........OK

0: The total amount of wall time = 299.875969
0: The maximum resident set size (KB) = 2054028
0: The total amount of wall time = 300.313655
0: The maximum resident set size (KB) = 2073176

Test bit_base PASS


baseline dir = /scratch3/NCEPDEV/stmp/role.epic/ORT-stmp/role.epic/FV3_OPNREQ_TEST/OPNREQ_TEST/regional_control_std_base_intel
working dir = /scratch3/NCEPDEV/stmp/role.epic/ORT-ptmp/role.epic/FV3_OPNREQ_TEST/opnReqTest_3392042/dcp_dcp
working dir = /scratch3/NCEPDEV/stmp/role.epic/ORT-ptmp/role.epic/FV3_OPNREQ_TEST/opnReqTest_1787321/dcp_dcp
Checking test dcp results ....
Comparing dynf000.nc .....USING NCCMP......OK
Comparing dynf006.nc .....USING NCCMP......OK
Expand All @@ -33,14 +33,14 @@ Checking test dcp results ....
Comparing NATLEV.GrbF00 .....USING CMP......OK
Comparing NATLEV.GrbF06 .....USING CMP......OK

0: The total amount of wall time = 202.924593
0: The maximum resident set size (KB) = 1727056
0: The total amount of wall time = 202.973297
0: The maximum resident set size (KB) = 1721740

Test dcp PASS


baseline dir = /scratch3/NCEPDEV/stmp/role.epic/ORT-stmp/role.epic/FV3_OPNREQ_TEST/OPNREQ_TEST/regional_control_std_base_intel
working dir = /scratch3/NCEPDEV/stmp/role.epic/ORT-ptmp/role.epic/FV3_OPNREQ_TEST/opnReqTest_3392042/std_base_std_base
working dir = /scratch3/NCEPDEV/stmp/role.epic/ORT-ptmp/role.epic/FV3_OPNREQ_TEST/opnReqTest_1787321/std_base_std_base
Checking test std_base results ....
Moving baseline std_base files ....
Moving dynf000.nc .........OK
Expand All @@ -52,14 +52,14 @@ Moving baseline std_base files ....
Moving NATLEV.GrbF00 .........OK
Moving NATLEV.GrbF06 .........OK

0: The total amount of wall time = 202.582884
0: The maximum resident set size (KB) = 1730396
0: The total amount of wall time = 202.275281
0: The maximum resident set size (KB) = 1709844

Test std_base PASS


baseline dir = /scratch3/NCEPDEV/stmp/role.epic/ORT-stmp/role.epic/FV3_OPNREQ_TEST/OPNREQ_TEST/regional_control_std_base_intel
working dir = /scratch3/NCEPDEV/stmp/role.epic/ORT-ptmp/role.epic/FV3_OPNREQ_TEST/opnReqTest_3392042/thr_thr
working dir = /scratch3/NCEPDEV/stmp/role.epic/ORT-ptmp/role.epic/FV3_OPNREQ_TEST/opnReqTest_1787321/thr_thr
Checking test thr results ....
Comparing dynf000.nc .....USING NCCMP......OK
Comparing dynf006.nc .....USING NCCMP......OK
Expand All @@ -70,11 +70,11 @@ Checking test thr results ....
Comparing NATLEV.GrbF00 .....USING CMP......OK
Comparing NATLEV.GrbF06 .....USING CMP......OK

0: The total amount of wall time = 202.389226
0: The maximum resident set size (KB) = 1723248
0: The total amount of wall time = 202.899558
0: The maximum resident set size (KB) = 1726100

Test thr PASS

OPERATION REQUIREMENT TEST WAS SUCCESSFUL
Mon Jun 1 22:19:30 UTC 2026
Elapsed time: 01h:05m:21s. Have a nice day!
Wed Jun 3 22:08:01 UTC 2026
Elapsed time: 01h:04m:32s. Have a nice day!
Loading
Loading