E1117 17:21:11.950483 4200 reflector.go:138] k8s.io/client-go/tools/watch/informerwatcher.go:146: Failed to watch *v1.ClusterVersion: the server is currently unable to handle sions.config.openshift.io)

[luke2261git]

I was following the procedure outlined here:

https://github.com/ryanhay/ocp4-metal-install#openshift-4-bare-metal-install---user-provisioned-infrastructure-upi

I was able to build a cluster 1 time with sucess.

However, trying to repeat the process and make sure I have the installation process down, I have twice attempted to recreate. I setup a pxeboot process to speed up the test installations. The basic issue is that I am unable to access the console url:

https://console-openshift-console.apps.lab.ocp.lan/

ocp_2nd_build> /root/openshift-install --dir /root/ocp-install wait-for bootstrap-complete --log-level=debug
DEBUG OpenShift Installer 4.9.5
DEBUG Built from commit 8223216bdcef5de56b52240ab7160ca909a9e56c
INFO Waiting up to 20m0s for the Kubernetes API at https://api.lab.ocp.lan:6443...
DEBUG Still waiting for the Kubernetes API: an error on the server ("") has prevented the request from succeeding
INFO API v1.22.0-rc.0+a44d0f0 up
INFO Waiting up to 30m0s for bootstrapping to complete...
DEBUG Bootstrap status: complete
INFO It is now safe to remove the bootstrap resources
DEBUG Time elapsed per stage:
DEBUG Bootstrap Complete: 8m14s
DEBUG API: 1m8s
INFO Time elapsed: 8m14s

ocp_2nd_build> /root/openshift-install --dir /root/ocp-install wait-for install-complete
INFO Waiting up to 40m0s for the cluster at https://api.lab.ocp.lan:6443 to initialize...
E1117 17:21:11.950483 4200 reflector.go:138] k8s.io/client-go/tools/watch/informerwatcher.go:146: Failed to watch *v1.ClusterVersion: the server is currently unable to handle
sions.config.openshift.io)ocp_2nd_build> oc version
Client Version: 4.9.5
Server Version: 4.9.5
Kubernetes Version: v1.22.0-rc.0+a44d0f0
ocp_2nd_build> kubectl version
Client Version: version.Info{Major:"1", Minor:"21", GitVersion:"v0.21.0-beta.1", GitCommit:"96e95cef877ba04872b88e4e2597eabb0174d182", GitTreeState:"clean", BuildDate:"2021-10-19T00:35:38Z", GoVersion:"go1.16.6", Compiler:"gc", Platform:"linux/amd64"}
Server Version: version.Info{Major:"1", Minor:"22+", GitVersion:"v1.22.0-rc.0+a44d0f0", GitCommit:"a44d0f017717d7bdd02c6fb64957e1380b821496", GitTreeState:"clean", BuildDate:"2021-10-22T03:07:44Z", GoVersion:"go1.16.6", Compiler:"gc", Platform:"linux/amd64"}
WARNING: version difference between client (0.21) and server (1.22) exceeds the supported minor version skew of +/-1

ocp_2nd_build> oc get nodes
NAME STATUS ROLES AGE VERSION
ocp-cp-1 Ready master,worker 58m v1.22.0-rc.0+a44d0f0
ocp-cp-2 Ready master,worker 58m v1.22.0-rc.0+a44d0f0
ocp-cp-3 Ready master,worker 57m v1.22.0-rc.0+a44d0f0
ocp-w-1 Ready worker 42m v1.22.0-rc.0+a44d0f0
ocp-w-2 Ready worker 42m v1.22.0-rc.0+a44d0f0

ocp_2nd_build> oc get csr
NAME AGE SIGNERNAME REQUESTOR
NDITION
csr-2q77d 57m kubernetes.io/kube-apiserver-client-kubelet system:serviceaccount:openshift-machine-config-operator:node-bootstrapper
proved,Issued
csr-76wmt 42m kubernetes.io/kubelet-serving system:node:ocp-w-2
proved,Issued
csr-7b2b9 51m kubernetes.io/kube-apiserver-client-kubelet system:serviceaccount:openshift-machine-config-operator:node-bootstrapper
proved,Issued
csr-7m4q7 42m kubernetes.io/kubelet-serving system:node:ocp-w-1
proved,Issued
csr-9tlkf 59m kubernetes.io/kube-apiserver-client-kubelet system:serviceaccount:openshift-machine-config-operator:node-bootstrapper
proved,Issued
csr-gfcck 58m kubernetes.io/kubelet-serving system:node:ocp-cp-2
proved,Issued
csr-ksbb7 58m kubernetes.io/kubelet-serving system:node:ocp-cp-1
proved,Issued
csr-mlnrj 59m kubernetes.io/kube-apiserver-client-kubelet system:serviceaccount:openshift-machine-config-operator:node-bootstrapper
proved,Issued
csr-pwsk9 57m kubernetes.io/kubelet-serving system:node:ocp-cp-3
proved,Issued
csr-zwszn 49m kubernetes.io/kube-apiserver-client-kubelet system:serviceaccount:openshift-machine-config-operator:node-bootstrapper
proved,Issued
system:openshift:openshift-authenticator-jqcjc 57m kubernetes.io/kube-apiserver-client system:serviceaccount:openshift-authentication-operator:authentication-opera
proved,Issued
system:openshift:openshift-monitoring-67hlk 57m kubernetes.io/kube-apiserver-client system:serviceaccount:openshift-monitoring:cluster-monitoring-operator
proved,Issued

ocp_2nd_build> oc get co|egrep "^authentication|^console|^ingress"

authentication 4.9.5 False False True 60m OAuthServerRouteEndpointAccessibleControllerAvailable: Get "https://oauth-opens
z": EOF
console 4.9.5 False True False 51m DeploymentAvailable: 0 replicas available for console deployment...
ingress 4.9.5 True False True 50m The "default" ingress controller reports Degraded=True: DegradedConditions: One
ions indicate a degraded state: CanaryChecksSucceeding=False (CanaryChecksRepetitiveFailures: Canary route checks for the default ingress controller are failing)

ocp_2nd_build> oc get co
NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE
authentication 4.9.5 False False True 36m OAuthServerRouteEndpointAccessibleControllerAvailable: Get "https://oauth-openshift.apps.lab.ocp.lan/healthz": EOF
baremetal 4.9.5 True False False 34m
cloud-controller-manager 4.9.5 True False False 36m
cloud-credential 4.9.5 True False False 36m
cluster-autoscaler 4.9.5 True False False 34m
config-operator 4.9.5 True False False 36m
console 4.9.5 False True False 26m DeploymentAvailable: 0 replicas available for console deployment...
csi-snapshot-controller 4.9.5 True False False 35m
dns 4.9.5 True False False 34m
etcd 4.9.5 True False False 34m
image-registry 4.9.5 True False False 26m
ingress 4.9.5 True False True 26m The "default" ingress controller reports Degraded=True: DegradedConditions: One or more other status conditions indicate a degraded state: CanaryChecksSucceeding=False (CanaryChecksRepetitiveFailures: Canary route checks for the default ingress controller are failing)
insights 4.9.5 True False False 29m
kube-apiserver 4.9.5 True False False 29m
kube-controller-manager 4.9.5 True False False 33m
kube-scheduler 4.9.5 True False False 34m
kube-storage-version-migrator 4.9.5 True False False 27m
machine-api 4.9.5 True False False 34m
machine-approver 4.9.5 True False False 34m
machine-config 4.9.5 True False False 34m
marketplace 4.9.5 True False False 34m
monitoring 4.9.5 True False False 25m
network 4.9.5 True False False 36m
node-tuning 4.9.5 True False False 34m
openshift-apiserver 4.9.5 True False False 29m
openshift-controller-manager 4.9.5 True False False 25m
openshift-samples 4.9.5 True False False 28m
operator-lifecycle-manager 4.9.5 True False False 35m
operator-lifecycle-manager-catalog 4.9.5 True False False 35m
operator-lifecycle-manager-packageserver 4.9.5 True False False 30m
service-ca 4.9.5 True False False 35m
storage 4.9.5 True False False 36m