This repository has been archived by the owner on Sep 12, 2024. It is now read-only.
-
Notifications
You must be signed in to change notification settings - Fork 51
Managing overflow sites like NERSC
Sharad Agarwal edited this page Nov 22, 2019
·
10 revisions
Unified extends the whitelist to NERSC in real time when conditions are met which are the following:
- FNAL agent
- Idle jobs / Running jobs > 0.5
- Campaign is setup with overflow OR the workflow requires no primary input (like wmLHEGS)
"overflow": {
"PRIM": {}
}
Module used in unified for managing overflow sites - equalizor.py
Unified adds NERSC to the DESIRED_Sites job classad! If we manage to add NERSC to the SiteWhitelist, then we would be able to use more NERSC resources (and get more work on the FNAL agents)
The reason NERSC is not in the original whitelist is that NERSC doesn’t have an entry for ncores and memory in gwmsmon, which Unified uses to filter out appropriate sites according to wf requirement