Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CloudSQLInstance contantly being updated #454

Open
bartse opened this issue Aug 20, 2022 · 5 comments
Open

CloudSQLInstance contantly being updated #454

bartse opened this issue Aug 20, 2022 · 5 comments
Labels
bug Something isn't working

Comments

@bartse
Copy link

bartse commented Aug 20, 2022

What happened?

  1. Using crossplane 1.9.0 + gcp provider 0.21.0 running on GKE 1.21
  2. Setup a CloudSQLInstance using below config
...
  forProvider:
    databaseVersion: POSTGRES_14
    instanceType: CLOUD_SQL_INSTANCE
    maxDiskSize: 40
    region: europe-west1
    settings:
      activationPolicy: ALWAYS
      availabilityType: ZONAL
      backupConfiguration:
        startTime: "04:00"
      dataDiskSizeGb: 10
      dataDiskType: PD_SSD
      ipConfiguration:
        privateNetwork: projects/<project-id>/global/networks/<network-name>
        requireSsl: true
      maintenanceWindow:
        day: 6
        hour: 23
        updateTrack: stable
      pricingPlan: PER_USE
      replicationType: SYNCHRONOUS
      storageAutoResize: true
      tier: db-custom-2-3840
...
  1. The provider is constantly updating the instance to a point where it fails
  Type     Reason                        Age                   From                                                 Message
  ----     ------                        ----                  ----                                                 -------
  Normal   CreatedExternalResource       5m46s                 managed/cloudsqlinstance.database.gcp.crossplane.io  Successfully requested creation of external resource
  Warning  CannotUpdateExternalResource  81s (x12 over 103s)   managed/cloudsqlinstance.database.gcp.crossplane.io  cannot update the CloudSQL instance: googleapi: Error 409: Operation failed because another opera
tion was already in progress. Try your request after the current operation is complete., operationInProgress
  Normal   UpdatedExternalResource       42s (x18 over 5m46s)  managed/cloudsqlinstance.database.gcp.crossplane.io  Successfully requested update of external resource

image

I did find earlier bug reports but those seem to have been fixed a while ago so not sure anyone else is experiencing this issue.

@bartse bartse added the bug Something isn't working label Aug 20, 2022
@miglocatiq
Copy link

I am seeing the same behavior using the same versions of crossplane, gcp-provider en GKE as @bartse. I had to disable public network ( for which i couldn't find an option in crossplane). Afterwards the DB is constantly being updated.

@pschmidbauer
Copy link

Happens for us, too. Constant update leads to 400 error messages per 5 minutes and makes it impossible to actually maintain the database in a stable way.

@CalinFlorescu
Copy link

CalinFlorescu commented Nov 10, 2022

I've encountered the same issue when working with this. I'm using the full URI for the private network, so it can't be that. I've tried to look through GCP logs to find out what the differences are between the two instance versions (the existing one and the one on which crossplane detects a change), and the only things that I found are these arguments:

connection_mode: ALLOW_ALL - is going to be added
ssl_params { <... omitted ...>   } - getting removed
I've tried to look in the documentation to see if these things can be specified, but I had no success.

@insider89
Copy link

The same issue is on the same provider version. We thought it was related failover replica, but looks like no. Any idea?

@CarpathianUA
Copy link

CarpathianUA commented Nov 18, 2022

I am experiencing the same. Deletion of CloudSQLInstance object and recreation of it solve the issue, but the initial behavior happens to us randomly

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

6 participants