Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a tier2 site config for AWS AMIs #1393

Open
wants to merge 31 commits into
base: develop
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from 11 commits
Commits
Show all changes
31 commits
Select commit Hold shift + click to select a range
c007a91
Initial commit of Tier2 AWS support
stiggy87 Dec 4, 2024
fa28e55
Updated READMEs to match formatting and corrected bash code
stiggy87 Dec 5, 2024
5c73a21
Cleaned up formatting for ubuntu README
stiggy87 Dec 5, 2024
bac62d0
Fixed some wrong versioning and cleaned up formatting for rocky8 README
stiggy87 Dec 5, 2024
459c1bb
Fixed file hierarchy for unit tests
stiggy87 Dec 5, 2024
926f541
Updated READMEs based on comments.
stiggy87 Dec 6, 2024
3892755
Added extra line at the end of file
stiggy87 Dec 6, 2024
e15a417
Added extra line end of intel yaml file
stiggy87 Dec 6, 2024
f1a5264
Removed openmpi from the mpi providers
stiggy87 Dec 6, 2024
e51ae22
Updated Rocky8 compiler.yaml
stiggy87 Dec 9, 2024
9c24649
Merge branch 'JCSDA:develop' into feature/tier2-aws-ami
stiggy87 Dec 9, 2024
78007a2
Merge branch 'feature/tier2-aws-ami' of https://github.com/stiggy87/s…
stiggy87 Dec 9, 2024
a9c136a
Merge branch 'JCSDA:develop' into feature/tier2-aws-ami
stiggy87 Dec 10, 2024
9576ce8
Updated Ubuntu README
stiggy87 Dec 11, 2024
1ddb3ad
Update Rocky8 README and yaml files
stiggy87 Dec 11, 2024
193b1a5
Merge branch 'feature/tier2-aws-ami' of https://github.com/stiggy87/s…
stiggy87 Dec 11, 2024
e182c6f
Merge branch 'JCSDA:develop' into feature/tier2-aws-ami
stiggy87 Dec 11, 2024
3bc3e01
Addressed comments.
stiggy87 Dec 12, 2024
6e65ab1
Fixed misspelings for update-alternatives
stiggy87 Dec 12, 2024
21a7fc7
Merge branch 'JCSDA:develop' into feature/tier2-aws-ami
stiggy87 Dec 12, 2024
b4dae92
Merge branch 'JCSDA:develop' into feature/tier2-aws-ami
stiggy87 Dec 12, 2024
f7a28fc
Changed version of gcc to install to gcc-11
stiggy87 Dec 12, 2024
d9d381f
Merge branch 'feature/tier2-aws-ami' of https://github.com/stiggy87/s…
stiggy87 Dec 12, 2024
7b2657c
Change the gcc from 12.3.0 to 11.4.0 for both gcc and intel builds.
stiggy87 Dec 13, 2024
eddb0a2
Added lines to have spack-stack Core modulefile to profile
stiggy87 Dec 17, 2024
e895b3b
Added:
stiggy87 Dec 17, 2024
450d01a
Merge branch 'JCSDA:develop' into feature/tier2-aws-ami
stiggy87 Dec 17, 2024
c4edee1
Merge branch 'feature/tier2-aws-ami' of https://github.com/stiggy87/s…
stiggy87 Dec 17, 2024
3b72fd0
Fixed openmpi version for module load
stiggy87 Dec 19, 2024
5b0464d
Merge branch 'develop' into feature/tier2-aws-ami
stiggy87 Dec 19, 2024
fc0d0b5
Merge branch 'develop' into feature/tier2-aws-ami
stiggy87 Dec 24, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
444 changes: 444 additions & 0 deletions configs/sites/tier2/aws-rocky8/README.md

Large diffs are not rendered by default.

15 changes: 15 additions & 0 deletions configs/sites/tier2/aws-rocky8/compilers.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,15 @@
compilers:
- compiler:
spec: [email protected]
paths:
cc: /opt/rh/gcc-toolset-11/root/user/bin/gcc
cxx: /opt/rh/gcc-toolset-11/root/user/bin/g++
f77: /opt/rh/gcc-toolset-11/root/user/bin/gfortran
fc: /opt/rh/gcc-toolset-11/root/user/bin/gfortran
flags: {}
operating_system: rocky8
target: x86_64
modules: []
environment: {}
extra_rpaths: []

stiggy87 marked this conversation as resolved.
Show resolved Hide resolved
9 changes: 9 additions & 0 deletions configs/sites/tier2/aws-rocky8/config.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
config:
build_jobs: 8

# Overrides for spack build and staging areas to speed up builds
# by using a local directory instead of the EFS shared filesystem
build_stage: /tmp/spack-stack/cache/build_stage
test_stage: /tmp/spack-stack/cache/test_stage
source_cache: /tmp/spack-stack/cache/source_cache
misc_cache: /tmp/spack-stack/cache/misc_cache
7 changes: 7 additions & 0 deletions configs/sites/tier2/aws-rocky8/modules.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
modules:
default:
enable::
- lmod
lmod:
include:
- python
94 changes: 94 additions & 0 deletions configs/sites/tier2/aws-rocky8/packages.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,94 @@
packages:
mysql:
externals:
- spec: [email protected]
prefix: /usr
wget:
externals:
- spec: [email protected]
prefix: /usr
binutils:
externals:
- spec: [email protected]
prefix: /usr
coreutils:
externals:
- spec: [email protected]
prefix: /usr
diffutils:
externals:
- spec: [email protected]
prefix: /usr
findutils:
externals:
- spec: [email protected]
prefix: /usr
gawk:
externals:
- spec: [email protected]
prefix: /usr
tar:
externals:
- spec: [email protected]
prefix: /usr
autoconf:
externals:
- spec: [email protected]
prefix: /usr
automake:
externals:
- spec: [email protected]
prefix: /usr
flex:
externals:
- spec: [email protected]+lex
prefix: /usr
gettext:
externals:
- spec: [email protected]
prefix: /usr
git:
externals:
- spec: [email protected]~tcltk
prefix: /usr
git-lfs:
externals:
- spec: [email protected]
prefix: /usr
gmake:
externals:
- spec: [email protected]
prefix: /usr
groff:
externals:
- spec: [email protected]
prefix: /usr
libtool:
externals:
- spec: [email protected]
prefix: /usr
m4:
externals:
- spec: [email protected]
prefix: /usr
perl:
externals:
- spec: [email protected]~cpanm+opcode+open+shared+threads
prefix: /usr
pkg-config:
externals:
- spec: [email protected]
prefix: /usr
qt:
buildable: false
externals:
- spec: [email protected]
prefix: /usr
sed:
externals:
- spec: [email protected]
prefix: /usr
lcms:
externals:
- spec: [email protected]
prefix: /usr
5 changes: 5 additions & 0 deletions configs/sites/tier2/aws-rocky8/packages_gcc.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
packages:
all:
compiler:: [[email protected]]
providers:
mpi:: [[email protected]]
30 changes: 30 additions & 0 deletions configs/sites/tier2/aws-rocky8/packages_intel.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,30 @@
packages:
all:
compiler:: [[email protected],[email protected]]
providers:
mpi:: [[email protected]]
# Remove the next three lines to switch to intel-oneapi-mkl
blas:: [openblas]
fftw-api:: [fftw]
lapack:: [openblas]
mpi:
buildable: False
intel-oneapi-mpi:
externals:
- spec: [email protected]%[email protected]
prefix: /opt/intel/oneapi
intel-oneapi-mkl:
# Remove buildable: False and configure version+uncomment externals section below to use intel-oneapi-mkl
buildable: False
#externals:
#- spec: [email protected]%[email protected]
# prefix: /opt/intel/oneapi
ectrans:
require::
- '@1.2.0 ~mkl +fftw'
gsibec:
require::
- '@1.2.1 ~mkl'
py-numpy:
require::
- '@:1.23 ^openblas'
Loading
Loading