Dev 0.22 #1011

dominichofer · 2024-11-05T14:59:57Z

Removes these packages:

cosmo, because spack spec cosmo emites Error: Spack concretizer internal error. Please submit a bug report and include the command, environment if applicable and the following error message. cosmo is unsatisfiable
fdb-fortran, because MeteoSwiss doesn't use it anymore.
fdb, because the upstream package is sufficient.
metkit, because the upstream package is sufficient.
py-frozendict, , because the upstream package is sufficient.
py-lark, because the upstream package is sufficient.
xpmem, because the upstream package is sufficient.
pytorch-fortran, because not needed anymore
pytorch-fortran-proxy, because not needed anymore
libtorch, because not needed anymore
oasis, because not needed anymore
int2lm because not needed anymore

github-actions · 2024-11-05T15:00:39Z

PR Preview Action v1.6.0
Preview removed because the pull request was closed.
2025-01-28 16:03 UTC

* upgrade docs * add yaml example * update docs

jonasjucker · 2024-12-09T14:13:30Z

launch jenkins

dominichofer · 2024-12-09T14:32:49Z

docs/CodeDevelopment.rst

+    $ spack dev-build --until build <package> @<version>
+
+This will build the package as is. The downside of this approach is that
+you need to go through all phases of a package build.


That's not true for icon. Icon sometimes skips stuff.

jonasjucker · 2024-12-10T08:20:04Z

launch jenkins

dominichofer · 2024-12-10T12:50:41Z

Jenkinsfile

+                    stage('Create uenv') {
+                        steps {
+                            sh """
+                            git clone -b fix/jenkins https://github.com/eth-cscs/uenv.git


Warning: This is a branch!

lxavier · 2024-12-20T15:25:07Z

FYI I manually tested this branch with v8 release candidate on Balfrin - ICON compiles but does not validate - this should be investigated before considering merging this branch

huppd · 2024-12-20T15:29:08Z

FYI I manually tested this branch with v8 release candidate on Balfrin - ICON compiles but does not validate - this should be investigated before considering merging this branch

Is this with new references? I think the optimization level has changed so, it might be just that.

jonasjucker · 2025-01-09T10:38:33Z

FYI I manually tested this branch with v8 release candidate on Balfrin - ICON compiles but does not validate - this should be investigated before considering merging this branch

Is this with new references? I think the optimization level has changed so, it might be just that.

Indeed it was the different opt-level.

Using -O with 0.22 leads to

check.c2sm_clm_r13b03_seaice.run                  : OK (jobID:2025148)
check.mch_ch_lowres.run                           : OK (jobID:2025149)
check.mch_icon-ch1_small.run                      : OK (jobID:2025150)
check.mch_icon-ch2_small.run                      : OK (jobID:2025151)
check.mch_kenda-ch1_small.run                     : OK (jobID:2025152)
check.mch_opr_r04b07.run                          : OK (jobID:2025153)
check.mch_opr_r04b07_lhn_00.run                   : OK (jobID:2025154)
check.mch_opr_r04b07_lhn_12_emvorado.run          : OK (jobID:2025155)
check.mch_opr_r04b07_nest.run                     : OK (jobID:2025156)
check.mch_opr_r04b07_performance.run              : OK (jobID:2025157)
check.mch_opr_r04b07_sstice_inst.run              : OK (jobID:2025158)
check.mch_opr_r19b07_lpi.run                      : OK (jobID:2025159)
check.mch_opr_r19b07_turb.run                     : OK (jobID:2025160)
check.mch_pollen_test.run                         : OK (jobID:2025161)

Assuming compiler does still the right things with -O2 we can move on here

huppd · 2025-01-09T15:21:19Z

FYI I manually tested this branch with v8 release candidate on Balfrin - ICON compiles but does not validate - this should be investigated before considering merging this branch

Is this with new references? I think the optimization level has changed so, it might be just that.

Indeed it was the different opt-level.

Using -O with 0.22 leads to

check.c2sm_clm_r13b03_seaice.run                  : OK (jobID:2025148)
check.mch_ch_lowres.run                           : OK (jobID:2025149)
check.mch_icon-ch1_small.run                      : OK (jobID:2025150)
check.mch_icon-ch2_small.run                      : OK (jobID:2025151)
check.mch_kenda-ch1_small.run                     : OK (jobID:2025152)
check.mch_opr_r04b07.run                          : OK (jobID:2025153)
check.mch_opr_r04b07_lhn_00.run                   : OK (jobID:2025154)
check.mch_opr_r04b07_lhn_12_emvorado.run          : OK (jobID:2025155)
check.mch_opr_r04b07_nest.run                     : OK (jobID:2025156)
check.mch_opr_r04b07_performance.run              : OK (jobID:2025157)
check.mch_opr_r04b07_sstice_inst.run              : OK (jobID:2025158)
check.mch_opr_r19b07_lpi.run                      : OK (jobID:2025159)
check.mch_opr_r19b07_turb.run                     : OK (jobID:2025160)
check.mch_pollen_test.run                         : OK (jobID:2025161)

Assuming compiler does still the right things with -O2 we can move on here

Cool, thanks for testing :)

This is used with eccodes 2.36.4 This is required to test v8 env on balfrin

lxavier · 2025-01-21T08:26:46Z

from MeteoSwiss side, we are now able to build icon using this branch on Balfrin with uenv mch/v8:rc4.

This is not a blocker to merge

jonasjucker · 2025-01-27T13:52:54Z

launch jenkins

jonasjucker · 2025-01-27T16:05:31Z

launch jenkins

jonasjucker · 2025-01-27T17:00:15Z

all tests pass, except for the sql error in icon4py due to race condition.

Jenkinsfile

dominichofer and others added 17 commits October 31, 2024 11:05

Set submodule spack to v0.22.2

58dd558

fdb: Remove package

e95aaae

metkit: Remove package

8592711

py-frozendict: Remove package

4f1ce65

xpmem: Remove package

0116e61

py-hatchling: Update from upstream

40eb0a7

py-tabulate: Update from upstream

698bd7f

icon-ham: Use spack/icon

561c571

icon: Split package

2c6231e

py-lark: Remove package

6cf047a

Remove unnecessary tests

118109d

Migrate unit tests to pytest

695ac57

Rename icon to icon-c2sm

491591d

cosmo: Remove package

2a7a337

Jenkins: Use mch/prgenv-icon:rc1

a1e05dd

GitHub Action: Apply Pep8-formatting

9b5c5be

Merge branch 'main' into dev_0.22

a2acb40

dominichofer added 7 commits November 5, 2024 16:24

Add tests for 'spack find' and 'spack compilers'.

6ff2517

Start uenv in test stages

de903c8

deactivate

1059f74

Simplify run_with_spack

4a3cf6d

Keep venv

8b5222c

Bring back devirtualization

77df0b9

Update uenv

e073f3c

dominichofer force-pushed the dev_0.22 branch from ad958a9 to e073f3c Compare November 6, 2024 15:11

dominichofer and others added 4 commits November 6, 2024 17:28

Use .venv

c827041

GitHub Action: Apply Pep8-formatting

bce9413

Shuffle Jenkinsfile

5c42d6e

revert

e352780

upgrade docs (#1038)

52db158

* upgrade docs * add yaml example * update docs

dominichofer commented Dec 9, 2024

View reviewed changes

update docs

ca2ba85

dominichofer commented Dec 10, 2024

View reviewed changes

lxavier and others added 2 commits January 15, 2025 15:23

Update cosmo-eccodes-definitions versions to 2.36.0.3

8150572

This is used with eccodes 2.36.4 This is required to test v8 env on balfrin

use explicit zlib-ng dependency for icon (#1040)

98de61c

use rc 4

08b457a

jonasjucker added 2 commits January 27, 2025 17:02

remove obsolete packages

979f9b7

adjust integration tests

7869af5

upgrade manual to build icon

615da3e

lxavier reviewed Jan 28, 2025

View reviewed changes

Jenkinsfile Show resolved Hide resolved

jonasjucker self-requested a review January 28, 2025 15:55

jonasjucker approved these changes Jan 28, 2025

View reviewed changes

jonasjucker merged commit 6ed9b0f into main Jan 28, 2025
2 checks passed

jonasjucker deleted the dev_0.22 branch January 28, 2025 16:03

This was referenced Jan 28, 2025

eccodes #1021

Closed

fdb #1022

Closed

metkit #1024

Closed

py-frozendict #1025

Closed

py-lark #1027

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Dev 0.22 #1011

Dev 0.22 #1011

dominichofer commented Nov 5, 2024 •

edited by jonasjucker

Loading

github-actions bot commented Nov 5, 2024 •

edited

Loading

jonasjucker commented Dec 9, 2024

dominichofer Dec 9, 2024 •

edited

Loading

jonasjucker commented Dec 10, 2024

dominichofer Dec 10, 2024

lxavier commented Dec 20, 2024

huppd commented Dec 20, 2024

jonasjucker commented Jan 9, 2025

huppd commented Jan 9, 2025

lxavier commented Jan 21, 2025

jonasjucker commented Jan 27, 2025

jonasjucker commented Jan 27, 2025

jonasjucker commented Jan 27, 2025

Dev 0.22 #1011

Dev 0.22 #1011

Conversation

dominichofer commented Nov 5, 2024 • edited by jonasjucker Loading

github-actions bot commented Nov 5, 2024 • edited Loading

jonasjucker commented Dec 9, 2024

dominichofer Dec 9, 2024 • edited Loading

Choose a reason for hiding this comment

jonasjucker commented Dec 10, 2024

dominichofer Dec 10, 2024

Choose a reason for hiding this comment

lxavier commented Dec 20, 2024

huppd commented Dec 20, 2024

jonasjucker commented Jan 9, 2025

huppd commented Jan 9, 2025

lxavier commented Jan 21, 2025

jonasjucker commented Jan 27, 2025

jonasjucker commented Jan 27, 2025

jonasjucker commented Jan 27, 2025

dominichofer commented Nov 5, 2024 •

edited by jonasjucker

Loading

github-actions bot commented Nov 5, 2024 •

edited

Loading

dominichofer Dec 9, 2024 •

edited

Loading