Managing overflow sites like NERSC

Unified extends the whitelist to NERSC in real time when conditions are met which are the following:

• FNAL agent
• Idle jobs / Running jobs > 0.5
• Campaign is setup with overflow OR the workflow requires no primary input (like wmLHEGS)

 "overflow": {
      "PRIM": {}
    }

Module used in unified for managing overflow sites - equalizor.py

side note from Alan

Unified adds NERSC to the DESIRED_Sites job classad! If we manage to add NERSC to the SiteWhitelist, then we would be able to use more NERSC resources (and get more work on the FNAL agents)

side note from Thong

The reason NERSC is not in the original whitelist is that NERSC doesn’t have an entry for ncores and memory in gwmsmon, which Unified uses to filter out appropriate sites according to wf requirement