PVC/PV Cleanup Strategy with K8s Reconciler ⚠️

[lbeckman314]

Overview 🌀

When the K8s reconciler is enabled, Funnel appears to "clean up" the PVC/PV used by the Worker and Executor before the client (e.g. Nextflow) has a chance to read the outputs.

Expected Behavior

The Worker and Executor PVC/PV's should remain until the client is done reading/accessing them.

Actual Behavior

The PVC/PV's are removed and Nextflow throws the following Example Error ⚠️

java.nio.file.NoSuchFileException: /var/folders/_8/5_1db5ds3h3fbjvxvb7q6z7h0000gn/T/temp-s3-12235337140107845292/.command.out