EMR EKS DAG stabilisation for astronomer-providers

[pankajkoti]

Take care of cleaning up following resources:

• VPC created by the DAG
• OIDC created by the DAG

[phanikumv]

just see whether it is worth the time because we are planning to deprecate stuff soon.

[pankajkoti]

Even if we deprecate, wouldn't we keep running the integration tests? That would help us test the RCs right?

[phanikumv]

IMO , since we already have integration tests dashboard from Amazon on OSS, once we point our provider to use OSS one, we should remove integration tests as well - as we no longer maintain our version of providers.

[pankajkoti]

yes, that would be nice, we would save costs on spinning up AWS resources in that case

[vatsrahul1001]

OIDC deletion logic fixed in PR

[vatsrahul1001]

as per discussion with @phanikumv I have raised request to increase VPC limit to 15

[vatsrahul1001]

Putting this ticket on hold to monitor failures

[pankajkoti]

@vatsrahul1001 do you think we can close this issue?

[vatsrahul1001]

@pankajkoti no I still see some failures due to this

[phanikumv]

Closing as the provider is being deprecated