No leader in kubernetes

[mamazary]

I installed a dkron using helm in kubernetes, no configuration has been made, only add toleration in values.
But when I checked the UI, there's no leader, could you help me about this ?

Logs for dkron-server-0
time="2023-08-08T07:09:32Z" level=info msg="No valid config found: Applying default values." error="open /etc/dkron/dkron.yaml: no such file or directory" time="2023-08-08T07:09:32Z" level=warning msg="plugin configured with a nil SecureConfig" node=dkron-server-0 time="2023-08-08T07:09:32Z" level=warning msg="plugin configured with a nil SecureConfig" node=dkron-server-0 time="2023-08-08T07:09:32Z" level=warning msg="plugin configured with a nil SecureConfig" node=dkron-server-0 time="2023-08-08T07:09:32Z" level=warning msg="plugin configured with a nil SecureConfig" node=dkron-server-0 time="2023-08-08T07:09:32Z" level=warning msg="plugin configured with a nil SecureConfig" node=dkron-server-0 time="2023-08-08T07:09:32Z" level=warning msg="plugin configured with a nil SecureConfig" node=dkron-server-0 time="2023-08-08T07:09:32Z" level=warning msg="plugin configured with a nil SecureConfig" node=dkron-server-0 time="2023-08-08T07:09:32Z" level=warning msg="plugin configured with a nil SecureConfig" node=dkron-server-0 time="2023-08-08T07:09:32Z" level=warning msg="plugin configured with a nil SecureConfig" node=dkron-server-0 time="2023-08-08T07:09:32Z" level=warning msg="plugin configured with a nil SecureConfig" node=dkron-server-0 time="2023-08-08T07:09:32Z" level=warning msg="plugin configured with a nil SecureConfig" node=dkron-server-0 time="2023-08-08T07:09:32Z" level=info msg="agent: Dkron agent starting" node=dkron-server-0 time="2023-08-08T07:09:32Z" level=info msg="agent: Retry join LAN is supported for: aliyun aws azure digitalocean gce k8s linode mdns os packet scaleway softlayer tencentcloud triton vsphere" node=dkron-server-0 time="2023-08-08T07:09:32Z" level=info msg="agent: Joining cluster..." cluster=LAN node=dkron-server-0 time="2023-08-08T07:09:32Z" level=info msg="2023/08/08 07:09:32 discover.go:178: [DEBUG] discover: Using provider \"k8s\"" time="2023-08-08T07:09:32Z" level=info msg="agent: Discovered LAN servers: 192.168.4.207 192.168.4.208" node=dkron-server-0 time="2023-08-08T07:09:32Z" level=info msg="agent: Join LAN completed. Synced with 2 initial agents" node=dkron-server-0 time="2023-08-08T07:09:32Z" level=info msg="api: Running HTTP server" address=":8080" node=dkron-server-0 time="2023-08-08T07:09:33Z" level=info msg="dkron: monitoring leadership" node=dkron-server-0 time="2023-08-08T07:09:33Z" level=info msg="agent: registering usage stats for cluster ID '4x8p65Ra3mIWoMpbqgAfqxB9ypv6O2ik3pxwu5H3K8I='" node=dkron-server-0 time="2023-08-08T07:09:33Z" level=info msg="agent: Listen for events" node=dkron-server-0 time="2023-08-08T07:09:34Z" level=info msg="agent: Received event" event=member-update node=dkron-server-0 time="2023-08-08T07:09:34Z" level=info msg="agent: Received event" event=member-join node=dkron-server-0 time="2023-08-08T07:09:34Z" level=warning msg="non-server in gossip pool" member=dkron-agent-6859bb59f7-cz9jr node=dkron-server-0 time="2023-08-08T07:09:47Z" level=info msg="agent: Received event" event=member-update node=dkron-server-0 time="2023-08-08T07:09:53Z" level=info msg="agent: Received event" event=member-update node=dkron-server-0 time="2023-08-08T07:17:34Z" level=error msg="no member leader found in member list" node=dkron-server-0 time="2023-08-08T07:19:41Z" level=error msg="no member leader found in member list" node=dkron-server-0

Logs for dkron-server-1
time="2023-08-08T07:09:44Z" level=info msg="No valid config found: Applying default values." error="open /etc/dkron/dkron.yaml: no such file or directory" time="2023-08-08T07:09:44Z" level=warning msg="plugin configured with a nil SecureConfig" node=dkron-server-1 time="2023-08-08T07:09:44Z" level=warning msg="plugin configured with a nil SecureConfig" node=dkron-server-1 time="2023-08-08T07:09:45Z" level=warning msg="plugin configured with a nil SecureConfig" node=dkron-server-1 time="2023-08-08T07:09:45Z" level=warning msg="plugin configured with a nil SecureConfig" node=dkron-server-1 time="2023-08-08T07:09:45Z" level=warning msg="plugin configured with a nil SecureConfig" node=dkron-server-1 time="2023-08-08T07:09:45Z" level=warning msg="plugin configured with a nil SecureConfig" node=dkron-server-1 time="2023-08-08T07:09:45Z" level=warning msg="plugin configured with a nil SecureConfig" node=dkron-server-1 time="2023-08-08T07:09:45Z" level=warning msg="plugin configured with a nil SecureConfig" node=dkron-server-1 time="2023-08-08T07:09:45Z" level=warning msg="plugin configured with a nil SecureConfig" node=dkron-server-1 time="2023-08-08T07:09:46Z" level=warning msg="plugin configured with a nil SecureConfig" node=dkron-server-1 time="2023-08-08T07:09:46Z" level=warning msg="plugin configured with a nil SecureConfig" node=dkron-server-1 time="2023-08-08T07:09:46Z" level=info msg="agent: Dkron agent starting" node=dkron-server-1 time="2023-08-08T07:09:46Z" level=info msg="agent: Retry join LAN is supported for: aliyun aws azure digitalocean gce k8s linode mdns os packet scaleway softlayer tencentcloud triton vsphere" node=dkron-server-1 time="2023-08-08T07:09:46Z" level=info msg="agent: Joining cluster..." cluster=LAN node=dkron-server-1 time="2023-08-08T07:09:46Z" level=info msg="2023/08/08 07:09:46 discover.go:178: [DEBUG] discover: Using provider \"k8s\"" time="2023-08-08T07:09:46Z" level=info msg="2023/08/08 07:09:46 k8s_discover.go:141: [DEBUG] discover-k8s: ignoring pod \"dkron-server-2\", not running: \"Pending\"" time="2023-08-08T07:09:46Z" level=info msg="agent: Discovered LAN servers: 192.168.4.207 192.168.4.208 192.168.0.39" node=dkron-server-1 time="2023-08-08T07:09:46Z" level=info msg="agent: Join LAN completed. Synced with 3 initial agents" node=dkron-server-1 time="2023-08-08T07:09:46Z" level=info msg="api: Running HTTP server" address=":8080" node=dkron-server-1 time="2023-08-08T07:09:46Z" level=info msg="dkron: monitoring leadership" node=dkron-server-1 time="2023-08-08T07:09:46Z" level=info msg="agent: registering usage stats for cluster ID '7AQtYFl310xx1LCpb/xGDssh1IvcAePXL4qbXGlIWoE='" node=dkron-server-1 time="2023-08-08T07:09:46Z" level=info msg="agent: Listen for events" node=dkron-server-1 time="2023-08-08T07:09:47Z" level=info msg="agent: Received event" event=member-join node=dkron-server-1 time="2023-08-08T07:09:47Z" level=info msg="adding server" node=dkron-server-1 server=dkron-server-0 time="2023-08-08T07:09:47Z" level=warning msg="non-server in gossip pool" member=dkron-agent-6859bb59f7-cz9jr node=dkron-server-1 time="2023-08-08T07:09:47Z" level=info msg="agent: Received event" event=member-update node=dkron-server-1 time="2023-08-08T07:09:53Z" level=info msg="agent: Received event" event=member-update node=dkron-server-1

Logs for dkron-server-2
time="2023-08-08T07:09:51Z" level=info msg="No valid config found: Applying default values." error="open /etc/dkron/dkron.yaml: no such file or directory" time="2023-08-08T07:09:51Z" level=warning msg="plugin configured with a nil SecureConfig" node=dkron-server-2 time="2023-08-08T07:09:51Z" level=warning msg="plugin configured with a nil SecureConfig" node=dkron-server-2 time="2023-08-08T07:09:51Z" level=warning msg="plugin configured with a nil SecureConfig" node=dkron-server-2 time="2023-08-08T07:09:51Z" level=warning msg="plugin configured with a nil SecureConfig" node=dkron-server-2 time="2023-08-08T07:09:51Z" level=warning msg="plugin configured with a nil SecureConfig" node=dkron-server-2 time="2023-08-08T07:09:51Z" level=warning msg="plugin configured with a nil SecureConfig" node=dkron-server-2 time="2023-08-08T07:09:51Z" level=warning msg="plugin configured with a nil SecureConfig" node=dkron-server-2 time="2023-08-08T07:09:51Z" level=warning msg="plugin configured with a nil SecureConfig" node=dkron-server-2 time="2023-08-08T07:09:51Z" level=warning msg="plugin configured with a nil SecureConfig" node=dkron-server-2 time="2023-08-08T07:09:51Z" level=warning msg="plugin configured with a nil SecureConfig" node=dkron-server-2 time="2023-08-08T07:09:52Z" level=warning msg="plugin configured with a nil SecureConfig" node=dkron-server-2 time="2023-08-08T07:09:52Z" level=info msg="agent: Dkron agent starting" node=dkron-server-2 time="2023-08-08T07:09:52Z" level=info msg="agent: Retry join LAN is supported for: aliyun aws azure digitalocean gce k8s linode mdns os packet scaleway softlayer tencentcloud triton vsphere" node=dkron-server-2 time="2023-08-08T07:09:52Z" level=info msg="agent: Joining cluster..." cluster=LAN node=dkron-server-2 time="2023-08-08T07:09:52Z" level=info msg="2023/08/08 07:09:52 discover.go:178: [DEBUG] discover: Using provider \"k8s\"" time="2023-08-08T07:09:52Z" level=info msg="agent: Discovered LAN servers: 192.168.4.207 192.168.4.208 192.168.0.39 192.168.4.209" node=dkron-server-2 time="2023-08-08T07:09:52Z" level=info msg="agent: Join LAN completed. Synced with 4 initial agents" node=dkron-server-2 time="2023-08-08T07:09:52Z" level=info msg="api: Running HTTP server" address=":8080" node=dkron-server-2 time="2023-08-08T07:09:52Z" level=info msg="dkron: monitoring leadership" node=dkron-server-2 time="2023-08-08T07:09:52Z" level=info msg="agent: registering usage stats for cluster ID '5KqkCQw5NZWTGDG2Kfa+74dAQtpAe2dC+WJvJ5oMUNA='" node=dkron-server-2 time="2023-08-08T07:09:52Z" level=info msg="agent: Listen for events" node=dkron-server-2 time="2023-08-08T07:09:53Z" level=info msg="agent: Received event" event=member-join node=dkron-server-2 time="2023-08-08T07:09:53Z" level=warning msg="non-server in gossip pool" member=dkron-agent-6859bb59f7-cz9jr node=dkron-server-2 time="2023-08-08T07:09:53Z" level=info msg="adding server" node=dkron-server-2 server=dkron-server-1 time="2023-08-08T07:09:53Z" level=info msg="adding server" node=dkron-server-2 server=dkron-server-0 time="2023-08-08T07:09:53Z" level=info msg="agent: Received event" event=member-update node=dkron-server-2

Logs for dkron-agent
time="2023-08-08T07:09:28Z" level=info msg="No valid config found: Applying default values." error="open /etc/dkron/dkron.yaml: no such file or directory" time="2023-08-08T07:09:28Z" level=warning msg="plugin configured with a nil SecureConfig" node=dkron-agent-6859bb59f7-cz9jr time="2023-08-08T07:09:28Z" level=warning msg="plugin configured with a nil SecureConfig" node=dkron-agent-6859bb59f7-cz9jr time="2023-08-08T07:09:28Z" level=warning msg="plugin configured with a nil SecureConfig" node=dkron-agent-6859bb59f7-cz9jr time="2023-08-08T07:09:28Z" level=warning msg="plugin configured with a nil SecureConfig" node=dkron-agent-6859bb59f7-cz9jr time="2023-08-08T07:09:28Z" level=warning msg="plugin configured with a nil SecureConfig" node=dkron-agent-6859bb59f7-cz9jr time="2023-08-08T07:09:28Z" level=warning msg="plugin configured with a nil SecureConfig" node=dkron-agent-6859bb59f7-cz9jr time="2023-08-08T07:09:28Z" level=warning msg="plugin configured with a nil SecureConfig" node=dkron-agent-6859bb59f7-cz9jr time="2023-08-08T07:09:28Z" level=warning msg="plugin configured with a nil SecureConfig" node=dkron-agent-6859bb59f7-cz9jr time="2023-08-08T07:09:28Z" level=warning msg="plugin configured with a nil SecureConfig" node=dkron-agent-6859bb59f7-cz9jr time="2023-08-08T07:09:28Z" level=warning msg="plugin configured with a nil SecureConfig" node=dkron-agent-6859bb59f7-cz9jr time="2023-08-08T07:09:28Z" level=warning msg="plugin configured with a nil SecureConfig" node=dkron-agent-6859bb59f7-cz9jr time="2023-08-08T07:09:28Z" level=info msg="agent: Dkron agent starting" node=dkron-agent-6859bb59f7-cz9jr time="2023-08-08T07:09:28Z" level=info msg="agent: Retry join LAN is supported for: aliyun aws azure digitalocean gce k8s linode mdns os packet scaleway softlayer tencentcloud triton vsphere" node=dkron-agent-6859bb59f7-cz9jr time="2023-08-08T07:09:28Z" level=info msg="agent: Joining cluster..." cluster=LAN node=dkron-agent-6859bb59f7-cz9jr time="2023-08-08T07:09:28Z" level=info msg="2023/08/08 07:09:28 discover.go:178: [DEBUG] discover: Using provider \"k8s\"" time="2023-08-08T07:09:28Z" level=info msg="2023/08/08 07:09:28 k8s_discover.go:141: [DEBUG] discover-k8s: ignoring pod \"dkron-server-0\", not running: \"Pending\"" time="2023-08-08T07:09:28Z" level=info msg="agent: Discovered LAN servers: 192.168.4.207" node=dkron-agent-6859bb59f7-cz9jr time="2023-08-08T07:09:28Z" level=info msg="agent: Join LAN completed. Synced with 1 initial agents" node=dkron-agent-6859bb59f7-cz9jr time="2023-08-08T07:09:28Z" level=info msg="agent: Listen for events" node=dkron-agent-6859bb59f7-cz9jr time="2023-08-08T07:09:29Z" level=info msg="agent: Received event" event=member-update node=dkron-agent-6859bb59f7-cz9jr time="2023-08-08T07:09:34Z" level=info msg="agent: Received event" event=member-update node=dkron-agent-6859bb59f7-cz9jr time="2023-08-08T07:09:47Z" level=info msg="agent: Received event" event=member-update node=dkron-agent-6859bb59f7-cz9jr time="2023-08-08T07:09:53Z" level=info msg="agent: Received event" event=member-update node=dkron-agent-6859bb59f7-cz9jr

Is there anything that I need to be set to run a Dkron in kubernetes ?

[maiku1008]

I am facing the same issue.

[OntologicalSin]

#11 might solve this problem