Problem with kubernetes and flocker agent-control node connectivity

[lainra]

Hello,

I tried to install Flocker with my Kubernetes cluster.
K8s version : 1.5.1
Flocker version : 1.15.0
I have problems similar to this old issue : kubernetes/kubernetes#17651
My nodes are on Centos 7.3.
I'm using VMWare-flocker-plugin to provision the storage. Everything is working as long as it doesn't deal with Kubernetes.
I tried both https://clusterhq.com/2015/12/22/ha-demo-kubernetes-flocker/ demo and https://github.com/vmware/vsphere-flocker-driver installation instructions.

The problem is that kubelet cannot reach the control node because it cannot fetch the environment variables :
FLOCKER_CONTROL_SERVICE_HOST
FLOCKER_CONTROL_SERVICE_PORT
FLOCKER_CONTROL_SERVICE_CA_FILE
FLOCKER_CONTROL_SERVICE_CLIENT_KEY_FILE
FLOCKER_CONTROL_SERVICE_CLIENT_CERT_FILE

I tried every single way to pass these variables :

• By setting them as temporary env var with export
• By setting them into /etc/.bashrc
• By passing them into /etc/systemd/system/kubelet.service file as Environment=
• By passing them into /etc/systemd/system/kubelet.service file as EnvironmentFile=/etc/kubernetes/kubelet.env containing all variables

Unfortunately, kubelet/flocker-agent doesn't seem to get these variables.

The datasetUUID for volume with datasetName='volume1' can not be found using flocker: Get https://localhost:4523/v1/configuration/datasets: dial tcp 127.0.0.1:4523: getsockopt: connection refused
This is because the https://github.com/kubernetes/kubernetes/blob/v1.5.1/pkg/volume/flocker/flocker.go
defines default variables as :

const (
	flockerPluginName = "kubernetes.io/flocker"

	defaultHost           = "localhost"
	defaultPort           = 4523
	defaultCACertFile     = "/etc/flocker/cluster.crt"
	defaultClientKeyFile  = "/etc/flocker/apiuser.key"
	defaultClientCertFile = "/etc/flocker/apiuser.crt"
	defaultMountPath      = "/flocker"

	timeoutWaitingForVolume = 2 * time.Minute
	tickerWaitingForVolume  = 5 * time.Second
)

I took the flocker.go module NewClient function from kubernetes/kubernetes github to test it on my machine :

package main

import (
  "fmt"
  "os"
)


func GetEnvAsStringOrFallback(key, defaultValue string) string {
        if v := os.Getenv(key); v != "" {
                return v
        }
        return defaultValue
}



func main() {
        fmt.Println(GetEnvAsStringOrFallback("FLOCKER_CONTROL_SERVICE_HOST", "default"))
}

and I get the variable :

[root@k8s-storage-s3 ~]# go run test.go 
192.168.40.31

I don't know what to do, there is only this problem left for my Kubernetes to work with Flocker.

[wallnerryan]

@lain92 did you reload the daemon config and restart the kubelet after placing the ENV variables in .service?

$ systemctl daemon-reload
$ systemctl restart kubelet

[lainra]

@wallnerryan yes, i did it dozens of times while troubleshooting

[wallnerryan]

FYI, This project is moving to https://github.com/ScatterHQ/flocker, a small number of the clusterhq folks will try to maintain it to a certain degree if the community wants it.