Previous and new users being stuck in pending status

[thomasj20git]

I ran into an issue with my cluster where my users were all created and I could login into each of the nodes with my users but now I cant and they are stuck in this pending to be created state.

[thomasj20git]

Active
Failed to execute cluster-init script '/mnt/cluster-init/slurm/login/scripts/00-install-login.sh' in project 'slurm' (return code: 1)
Software Configuration
Edit and re-upload the script to correct the error and try again
Get more help on this issue
Detail:
Script output:
An error occured during installation. See log file /var/log/azure-slurm-install.log for details.
2024-07-15 16:33:39,877 ERROR: An error occured during installation.
Traceback (most recent call last):
File "install.py", line 631, in
main()
File "install.py", line 604, in main
munge_key(settings)
File "install.py", line 207, in munge_key
ilib.copy_file(
File "/opt/cycle/jetpack/system/bootstrap/azure-slurm-install/installlib.py", line 148, in copy_file
shutil.copyfile(src=source, dst=dest)
File "/opt/cycle/jetpack/system/embedded/lib/python3.8/shutil.py", line 264, in copyfile
with open(src, 'rb') as fsrc, open(dst, 'wb') as fdst:
FileNotFoundError: [Errno 2] No such file or directory: '/sched/clusterpoc/munge.key'

[aditigaur4]

Did you restart the cluster when you saw the issue in cluster-init? which version of CC is this?