New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add a tier2 site config for AWS AMIs #1393

Open

stiggy87 wants to merge 31 commits into JCSDA:develop from stiggy87:feature/tier2-aws-ami

Contributor

stiggy87 commented Dec 5, 2024 •

edited

Loading

Summary

This is to add AWS as a tier2 supported platform. The two images are Rock8 and Ubuntu24.04.

Testing

I have custom built two running EC2 instances following these steps. However, Intel has had problems on both, and would like others in review to give it a test and provide feedback.

Applications affected

None. These are just platforms that can be used for development.

Systems affected

None. These are to support Rocky8 and Ubuntu24.04 EC2 instances.

Dependencies

Issue(s) addressed

Checklist

This PR addresses one issue/problem/enhancement, or has a very good reason for not doing so.
These changes have been tested on the affected systems and applications.
All dependency PRs/issues have been resolved and this PR can be merged.

stiggy87 added 4 commits

December 4, 2024 16:08


          Initial commit of Tier2 AWS support

c007a91


          Updated READMEs to match formatting and corrected bash code

fa28e55


          Cleaned up formatting for ubuntu README

5c73a21


          Fixed some wrong versioning and cleaned up formatting for rocky8 README

bac62d0

Contributor Author

stiggy87 commented Dec 5, 2024

@eap , @srherbener , @ashley314 , @ericlingerfelt

I have marked this is a draft PR since I believe there are still some possible issues/missing items in the steps. Could any of you test this out and let me know?

climbfuji added the INFRA label

climbfuji linked an issue

that may be closed by this pull request

Add a tier2 site config for AWS AMIs #1379

Open

Collaborator

climbfuji commented Dec 5, 2024

We don't support nested site hiearchies under tier1 and tier2, therefore the unit test failure.

Contributor Author

stiggy87 commented Dec 5, 2024

@climbfuji I saw, fixing that now.


          Fixed file hierarchy for unit tests

459c1bb

eap reviewed

View reviewed changes

Collaborator

eap left a comment

The ubuntu install is close but not there yet. I found a few issues in the install and config, see my notes. Right now it still can't build qhull with a variety of compiler errors.

configs/sites/tier2/aws-ubuntu2404/README.md Outdated Show resolved Hide resolved

configs/sites/tier2/aws-ubuntu2404/README.md Outdated Show resolved Hide resolved

configs/sites/tier2/aws-ubuntu2404/README.md Outdated Show resolved Hide resolved

configs/sites/tier2/aws-ubuntu2404/README.md Outdated Show resolved Hide resolved

configs/sites/tier2/aws-ubuntu2404/README.md Outdated Show resolved Hide resolved

configs/sites/tier2/aws-ubuntu2404/README.md Outdated Show resolved Hide resolved

configs/sites/tier2/aws-ubuntu2404/README.md Outdated Show resolved Hide resolved

configs/sites/tier2/aws-ubuntu2404/README.md Outdated Show resolved Hide resolved

configs/sites/tier2/aws-ubuntu2404/README.md Outdated Show resolved Hide resolved

configs/sites/tier2/aws-ubuntu2404/README.md Outdated Show resolved Hide resolved

climbfuji reviewed

View reviewed changes

configs/sites/tier2/aws-ubuntu2404/README.md Outdated Show resolved Hide resolved

climbfuji reviewed

View reviewed changes

configs/sites/tier2/aws-ubuntu2404/packages_gcc.yaml Outdated Show resolved Hide resolved

climbfuji reviewed

View reviewed changes

configs/sites/tier2/aws-rocky8/packages_intel.yaml Outdated Show resolved Hide resolved

climbfuji reviewed

View reviewed changes

configs/sites/tier2/aws-rocky8/packages_gcc.yaml Outdated Show resolved Hide resolved

climbfuji reviewed

View reviewed changes

configs/sites/tier2/aws-rocky8/compilers.yaml Show resolved Hide resolved

stiggy87 and others added 8 commits

December 6, 2024 14:16


          Updated READMEs based on comments.

926f541


          Added extra line at the end of file


          Added extra line end of intel yaml file

e15a417


          Removed openmpi from the mpi providers

f1a5264


          Updated Rocky8 compiler.yaml

e51ae22


          Merge branch 'JCSDA:develop' into feature/tier2-aws-ami

9c24649


          Merge branch 'feature/tier2-aws-ami' of https://github.com/stiggy87/s…

78007a2

…pack-stack into feature/tier2-aws-ami


          Merge branch 'JCSDA:develop' into feature/tier2-aws-ami

a9c136a

stiggy87 mentioned this pull request

Rocky8 module load fails to find glibc/2.28 when loading environments #1407

Closed

stiggy87 and others added 4 commits

December 11, 2024 16:32


          Updated Ubuntu README

9576ce8


          Update Rocky8 README and yaml files

1ddb3ad


          Merge branch 'feature/tier2-aws-ami' of https://github.com/stiggy87/s…

193b1a5

…pack-stack into feature/tier2-aws-ami


          Merge branch 'JCSDA:develop' into feature/tier2-aws-ami

e182c6f

stiggy87 mentioned this pull request

Intel install with eckit set to gcc does not create a module for eckit #1411

Closed

eap reviewed

View reviewed changes

Collaborator

eap left a comment

more comments

configs/sites/tier2/aws-ubuntu2404/README.md Outdated Show resolved Hide resolved

configs/sites/tier2/aws-ubuntu2404/README.md Outdated Show resolved Hide resolved

configs/sites/tier2/aws-ubuntu2404/README.md Outdated Show resolved Hide resolved

stiggy87 and others added 6 commits

December 12, 2024 09:38


          Addressed comments.

3bc3e01


          Fixed misspelings for update-alternatives

6e65ab1


          Merge branch 'JCSDA:develop' into feature/tier2-aws-ami

21a7fc7


          Merge branch 'JCSDA:develop' into feature/tier2-aws-ami

b4dae92


          Changed version of gcc to install to gcc-11

f7a28fc


          Merge branch 'feature/tier2-aws-ami' of https://github.com/stiggy87/s…

d9d381f

…pack-stack into feature/tier2-aws-ami

eap reviewed

View reviewed changes

Collaborator

eap left a comment

Getting close

configs/sites/tier2/aws-ubuntu2404/README.md Show resolved Hide resolved

configs/sites/tier2/aws-ubuntu2404/README.md Show resolved Hide resolved

configs/sites/tier2/aws-ubuntu2404/README.md Outdated Show resolved Hide resolved

configs/sites/tier2/aws-ubuntu2404/README.md Outdated Show resolved Hide resolved

configs/sites/tier2/aws-ubuntu2404/README.md Outdated Show resolved Hide resolved

configs/sites/tier2/aws-ubuntu2404/packages_gcc.yaml Outdated Show resolved Hide resolved

configs/sites/tier2/aws-ubuntu2404/packages_intel.yaml Outdated Show resolved Hide resolved

configs/sites/tier2/aws-ubuntu2404/README.md Show resolved Hide resolved

stiggy87 and others added 7 commits

December 13, 2024 09:46


          Change the gcc from 12.3.0 to 11.4.0 for both gcc and intel builds.

7b2657c


          Added lines to have spack-stack Core modulefile to profile

eddb0a2


          Added:

e895b3b

- external grep
- module use commands to profile.d
- mysql setup (for r2d2)


          Merge branch 'JCSDA:develop' into feature/tier2-aws-ami

450d01a


          Merge branch 'feature/tier2-aws-ami' of https://github.com/stiggy87/s…

c4edee1

…pack-stack into feature/tier2-aws-ami


          Fixed openmpi version for module load

3b72fd0


          Merge branch 'develop' into feature/tier2-aws-ami

5b0464d

stiggy87 marked this pull request as ready for review

December 19, 2024 23:21

stiggy87 requested a review from srherbener

December 19, 2024 23:21

Contributor Author

stiggy87 commented Dec 19, 2024

Marking this ready so when the blocking PR is fixed, this can be checked officially.

stiggy87 requested a review from eap

December 19, 2024 23:23


          Merge branch 'develop' into feature/tier2-aws-ami

fc0d0b5

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

INFRA