Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cannot delete snapshots A specified parameter was not correct #522

Open
braunsonm opened this issue Mar 27, 2023 · 0 comments
Open

Cannot delete snapshots A specified parameter was not correct #522

braunsonm opened this issue Mar 27, 2023 · 0 comments

Comments

@braunsonm
Copy link

braunsonm commented Mar 27, 2023

Describe the bug

It seems that at some point an upload failed so Velero left the snapshot on vSphere. Now I am unable to expand the volume but I also cannot delete the snapshot because there are no Snapshot resources anymore that are active.

To Reproduce

Unsure. Here is what I think reproduced it in my environment:

  1. Created a backup
  2. That backup failed to upload
  3. The snapshot expired and a DeleteSnapshot CR was created
  4. That DeleteSnapshot CR was marked as Completed even though it failed to delete from vSphere
  5. Creating subsequent DeleteSnapshot CR's if you happen to know the UID will also fail. The CR will show Completed even though it is failing the API call to vSphere.

Expected behavior

The snapshot should be deleted in vSphere.

Anything else you would like to add:

The vSphere Client shows Delete a virtual object snapshot: A specified parameter was not correct: (the last : is not a typo, the message just ends there).

In the backup-driver I see:

Disk doesn't have given snapshot due to the snapshot stamp was removed in the previous DeleteSnapshot operation which failed with InvalidState fault. And it will be resolved by the next snapshot operation on the same VM. Will NOT retry

What does this mean?

Is there a way to get the cluster back into a good state without deleting the PVC? As it stands:

  1. I cannot list all the snapshots which were left dangling unless I go into the datastore and look for fcd/<UID>-0000.vmdk but even then I do not know the snapshot ID
  2. I'm not sure what the API is in vSphere to trigger the deletion of this snapshot myself. How can I list and delete the existing orphaned snapshots of the fcd disks? Is there a govc command that I can use here?
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant