Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

no such option --force for aim runs close --force #3213

Open
ap-- opened this issue Aug 29, 2024 · 1 comment
Open

no such option --force for aim runs close --force #3213

ap-- opened this issue Aug 29, 2024 · 1 comment
Labels
help wanted Extra attention is needed type / bug Issue type: something isn't working

Comments

@ap--
Copy link

ap-- commented Aug 29, 2024

🐛 Bug

We're currently debugging why we can't resume a run. And we noticed that while the code here:

aim/aim/sdk/lock_manager.py

Lines 131 to 135 in a566d4a

raise RunLockingError(
f"Cannot acquire lock for Run '{run_hash}'. "
f"Make sure no process uses Run '{run_hash}' and close it via Aim CLI:\n"
f'`aim runs close --force {run_hash}`'
)

recommends to use aim runs close --force, the option does not exists

To reproduce

run aim runs close --force <somerunid>

Environment

  • Aim Version: 3.23.0

Thanks,
Andreas 😃

fyi: @jorenretel

@ap-- ap-- added help wanted Extra attention is needed type / bug Issue type: something isn't working labels Aug 29, 2024
@ap-- ap-- changed the title no such option --forve for aim runs close --force no such option --force for aim runs close --force Aug 29, 2024
@nickl1234567
Copy link

Hey, not sure if this is what you are struggling with, but I was and I want to leave the solution somewhere:
So in my case aim told me: aimrocks.errors.RocksIOError: b'IO error: While lock file: <path>/<id>/LOCK: Resource temporarily unavailable' when trying to resume a run. As you say aim runs close <id> did not work, and --force is not implemented. So the solution I came up with is: aim runs cp <id> --destination . assuming the aim directory is located in the current working directory. This command copies the run from the current aim repository and places it in the same repository (in my case) releasing the locks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
help wanted Extra attention is needed type / bug Issue type: something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants