Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Laghos comm cali #316

Open
wants to merge 43 commits into
base: develop
Choose a base branch
from
Open

Laghos comm cali #316

wants to merge 43 commits into from

Conversation

gracenansamba
Copy link
Collaborator

Here is the Laghos branch plus the changes I made.
I made changes in repo/mfem, and experiments/laghos/mpi/ramble.yaml

I have attached a link to mfem: https://github.com/gracenansamba/mfem.git

@github-actions github-actions bot added experiment New or modified experiment configs New or modified system config labels Jul 22, 2024
@github-actions github-actions bot added the application New or modified application label Jul 22, 2024
Copy link
Collaborator

@wdhawkins wdhawkins left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

As opposed to changing the Magma config, please create a new config for the 36 core/node system you are running on.

@@ -6,7 +6,7 @@
variables:
timeout: "120"
scheduler: "slurm"
sys_cores_per_node: "96"
sys_cores_per_node: "36"
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Since Magma really does have 96 cores, it's probably best not to change this value and, instead, create a new config for the 36-core system you'll be using.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@gracenansamba please remove the changes to the magma config from this PR. We should be using the Dane config instead (which I just added - please test).

@@ -45,7 +45,8 @@ ramble:
spack:
packages:
hypre-omp:
spack_spec: [email protected] +mpi+openmp+mixedint~fortran{modifier_spack_variant}
# spack_spec: [email protected] +mpi+openmp+mixedint~fortran{modifier_spack_variant}
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I generally prefer removing code/params that are commented out, but I can see the point in leaving them if it's likely you will revert to the original value at some point in the future. In that case, you may want to add a short comment to that effect This comment applies to several files in this comment, but I'll just note it here.


license("Apache-2.0")

version("develop", branch="main")
version("devlop", branch="comm_cali")
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

should be "develop" here.

"cce": "cray",
"gcc": "gnu",
}

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
variant("caliper", default=False, description="Build Caliper support")
def get_make_config_options(self, spec, prefix):
def yes_no(varstr):
return "YES" if varstr in self.spec else "NO"
options = super(Mfem, self).get_make_config_options(spec, prefix)
caliper_opt = ["MFEM_USE_CALIPER=%s" % yes_no("+caliper"), ]
return options + caliper_opt

@@ -15,6 +15,7 @@ compilers:
cflags: -g -O2
cxxflags: -g -O2 -std=c++17
fflags: -g -O2 -hnopattern
ldflags: {"-ldl"}
Copy link
Collaborator

@rfhaque rfhaque Aug 17, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@pearce8 @gracenansamba Had to add ldflags to get laghos running on tioga. The code runs on ruby, lassen and tioga in the mpi mode

@pearce8 pearce8 added the WIP A work-in-progress not yet ready to commit label Sep 27, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
application New or modified application configs New or modified system config experiment New or modified experiment WIP A work-in-progress not yet ready to commit
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants