Databricks managed resource groups should be removed when clean-up script runs

[ydaponte]

The clean-up script needs to be modified so it deletes all the resources that are included on the managed databricks resource group.
Deleting the main resource group triggers some resources deletes, but there are always two resources that are not deleted.

DoD

• Modify the clean-up script so it deletes the remaining databricks resources

[bsherwin]

Agreed. The problem is that the DBW resource groups are supposed to be managed, but there are two resources that are not being cleaned up...usually, a storage account and the databricks catalog connector.

I did some manual cleanup tonight while I was waiting for my stuff to deploy.

[saswata30]

The cleanup looks like taking a long time at my end as well

[bsherwin]

We should investigate if this is a Azure Databricks bug as this happens in the portal when removing RG with databricks environment. The UI reports success, but it is not deleted.