Multi-operator kubernetes cluster #796
Replies: 3 comments 12 replies
-
|
Hi @TobiasLetschka, are you able to reproduce this error creating a new ActiveMQArtemis CR in the same namespace? |
Beta Was this translation helpful? Give feedback.
-
|
Hi @brusdev , thank you for your answer. Where can i find the CR in github repo? |
Beta Was this translation helpful? Give feedback.
-
|
@TobiasLetschka the ActiveMQArtemis CRD is defined at https://github.com/artemiscloud/activemq-artemis-operator/blob/v1.0.16/deploy/crds/broker_activemqartemis_crd.yaml You can create a new simple ActiveMQArtemis CR in the same namespace using the following command: |
Beta Was this translation helpful? Give feedback.
-
|
@brusdev do I have to delete the operator first? |
Beta Was this translation helpful? Give feedback.
-
|
@TobiasLetschka no, you don't have to delete the operator first |
Beta Was this translation helpful? Give feedback.
-
|
@brusdev sorry i meant the broker not the operator |
Beta Was this translation helpful? Give feedback.
-
|
@TobiasLetschka no you don't need to delete anything. I proposed to create a new ActiveMQArtemis CR in the same namespace to try to reproduce this issue. |
Beta Was this translation helpful? Give feedback.
-
|
@brusdev if i create below broker that works |
Beta Was this translation helpful? Give feedback.
-
|
@TobiasLetschka without a reproducer its hard to find what caused your issue. My hypothesis is that 2 operator instances were trying to concurrently reconcile the ActiveMQArtemis CR with the name |
Beta Was this translation helpful? Give feedback.
-
|
@brusdev your hypothesis could be right because i see that:
|
Beta Was this translation helpful? Give feedback.
-
|
Hi @brusdev , what is the safest way to delete operator and artemis in kubernetes in one namespace? |
Beta Was this translation helpful? Give feedback.
-
|
Hi @TobiasLetschka, if the operator is installed in the namespace my-namespace and only serves the namespace my-namespace and you want to delete all ActiveMQArtemis CRs and the related resources from the namespace my-namespace the safest way is to delete all ActiveMQArtemis CRs and after that deleting the operator deployment. You can not delete CRDs if the operator is installed in other namespaces. |
Beta Was this translation helpful? Give feedback.
-
|
Hi @brusdev , |
Beta Was this translation helpful? Give feedback.
-
|
The ActiveMQArtemis CRs are the instances of the ActiveMQArtemis CRDs, you can list them with the following command: |
Beta Was this translation helpful? Give feedback.
-
|
thank you saves my day |
Beta Was this translation helpful? Give feedback.
-
Hi Team,
we use artemis cloud op in kubernetes v1.26.10. We have n namespaces with n operators and n brokers (single).
One operator runs in one mistake:
I0213 14:14:59.723366 1 leaderelection.go:248] attempting to acquire leader lease vth-genisys-prod/d864aab0.amq.io... I0213 14:15:16.443080 1 leaderelection.go:258] successfully acquired lease vth-genisys-prod/d864aab0.amq.io 2024-02-13T14:15:16.443Z INFO Starting EventSource {"controller": "activemqartemis", "controllerGroup": "broker.amq.io", "controllerKind": "ActiveMQArtemis", "source": "kind source: *v1beta1.ActiveMQArtemis"} 2024-02-13T14:15:16.443Z INFO Starting EventSource {"controller": "activemqartemis", "controllerGroup": "broker.amq.io", "controllerKind": "ActiveMQArtemis", "source": "kind source: *v1.StatefulSet"} 2024-02-13T14:15:16.443Z INFO Starting EventSource {"controller": "activemqartemis", "controllerGroup": "broker.amq.io", "controllerKind": "ActiveMQArtemis", "source": "kind source: *v1.Pod"} 2024-02-13T14:15:16.443Z INFO Starting EventSource {"controller": "activemqartemis", "controllerGroup": "broker.amq.io", "controllerKind": "ActiveMQArtemis", "source": "channel source: 0xc000380c80"} 2024-02-13T14:15:16.443Z INFO Starting Controller {"controller": "activemqartemis", "controllerGroup": "broker.amq.io", "controllerKind": "ActiveMQArtemis"} 2024-02-13T14:15:16.443Z INFO Starting EventSource {"controller": "activemqartemisscaledown", "controllerGroup": "broker.amq.io", "controllerKind": "ActiveMQArtemisScaledown", "source": "kind source: *v1beta1.ActiveMQArtemisScaledown"} 2024-02-13T14:15:16.443Z INFO Starting EventSource {"controller": "activemqartemisscaledown", "controllerGroup": "broker.amq.io", "controllerKind": "ActiveMQArtemisScaledown", "source": "kind source: *v1.Pod"} 2024-02-13T14:15:16.443Z INFO Starting Controller {"controller": "activemqartemisscaledown", "controllerGroup": "broker.amq.io", "controllerKind": "ActiveMQArtemisScaledown"} 2024-02-13T14:15:16.443Z INFO Starting EventSource {"controller": "activemqartemisaddress", "controllerGroup": "broker.amq.io", "controllerKind": "ActiveMQArtemisAddress", "source": "kind source: *v1beta1.ActiveMQArtemisAddress"} 2024-02-13T14:15:16.443Z INFO Starting EventSource {"controller": "activemqartemisaddress", "controllerGroup": "broker.amq.io", "controllerKind": "ActiveMQArtemisAddress", "source": "kind source: *v1.Pod"} 2024-02-13T14:15:16.443Z INFO Starting Controller {"controller": "activemqartemisaddress", "controllerGroup": "broker.amq.io", "controllerKind": "ActiveMQArtemisAddress"} 2024-02-13T14:15:16.444Z INFO Starting EventSource {"controller": "activemqartemissecurity", "controllerGroup": "broker.amq.io", "controllerKind": "ActiveMQArtemisSecurity", "source": "kind source: *v1beta1.ActiveMQArtemisSecurity"} 2024-02-13T14:15:16.444Z INFO Starting Controller {"controller": "activemqartemissecurity", "controllerGroup": "broker.amq.io", "controllerKind": "ActiveMQArtemisSecurity"} 2024-02-13T14:15:16.544Z INFO Starting workers {"controller": "activemqartemisscaledown", "controllerGroup": "broker.amq.io", "controllerKind": "ActiveMQArtemisScaledown", "worker count": 1} 2024-02-13T14:15:16.544Z INFO Starting workers {"controller": "activemqartemis", "controllerGroup": "broker.amq.io", "controllerKind": "ActiveMQArtemis", "worker count": 1} 2024-02-13T14:15:16.544Z INFO Starting workers {"controller": "activemqartemisaddress", "controllerGroup": "broker.amq.io", "controllerKind": "ActiveMQArtemisAddress", "worker count": 1} 2024-02-13T14:15:16.645Z INFO Starting workers {"controller": "activemqartemissecurity", "controllerGroup": "broker.amq.io", "controllerKind": "ActiveMQArtemisSecurity", "worker count": 1} 2024-02-13T14:15:17.069Z ERROR k8s_actions Failed to create new *v1.StatefulSet {"ActiveMQArtemis Name": "ex-aao-ss", "Namespace": "vth-genisys-prod", "error": "statefulsets.apps \"ex-aao-ss\" already exists"} github.com/go-logr/logr.Logger.Error /go/pkg/mod/github.com/go-logr/[email protected]/logr.go:279 github.com/artemiscloud/activemq-artemis-operator/pkg/resources.Create /workspace/app/pkg/resources/k8s_actions.go:27 github.com/artemiscloud/activemq-artemis-operator/controllers.(*ActiveMQArtemisReconcilerImpl).createRequestedResource /workspace/app/controllers/activemqartemis_reconciler.go:1359 github.com/artemiscloud/activemq-artemis-operator/controllers.(*ActiveMQArtemisReconcilerImpl).createResource /workspace/app/controllers/activemqartemis_reconciler.go:1343 github.com/artemiscloud/activemq-artemis-operator/controllers.(*ActiveMQArtemisReconcilerImpl).ProcessResourcesI think anything is missing. Maybe you can help me?
Regards Tobias
Beta Was this translation helpful? Give feedback.
All reactions