[Questions] RabbitMQ 4.0.5 Erlang 27.2 Windows standard installation service restart after one minute

[mraymondi-mito]

Community Support Policy

• I have read RabbitMQ's Community Support Policy
• I run RabbitMQ 4.x, the only series currently covered by community support
• I promise to provide all relevant information (versions, logs from all nodes, rabbitmq-diagnostics output, detailed reproduction steps)

RabbitMQ version used

4.0.5

Erlang version used

27.2.x

Operating system (distribution) used

Windows 11 Pro

How is RabbitMQ deployed?

Windows installer

rabbitmq-diagnostics status output

Error: unable to perform an operation on node 'rabbit@mauro-dell7740'. Please see diagnostics information and suggestions below.

Most common reasons for this are:

 * Target node is unreachable (e.g. due to hostname resolution, TCP connection or firewall issues)
 * CLI tool fails to authenticate with the server (e.g. due to CLI tool's Erlang cookie not matching that of the server)
 * Target node is not running

In addition to the diagnostics info below:

 * See the CLI, clustering and networking guides on https://rabbitmq.com/documentation.html to learn more
 * Consult server logs on node rabbit@mauro-dell7740
 * If target node is configured to use long node names, don't forget to use --longnames with CLI tools

DIAGNOSTICS
===========

attempted to contact: ['rabbit@mauro-dell7740']

rabbit@mauro-dell7740:
  * unable to connect to epmd (port 4369) on mauro-dell7740: address (cannot connect to host/port)


Current node details:
 * node name: 'rabbitmqcli-654-rabbit@mauro-dell7740'
 * effective user's home directory: c:/Users/mraym
 * Erlang cookie hash: kiR35aIU6z/OW82baMnIaQ==

Logs from node 1 (with sensitive values edited out)

2025-01-12 11:45:20.136000+01:00 [info] <0.475.0> Ready to start client connection listeners
2025-01-12 11:46:10.243000+01:00 [error] <0.475.0> 
2025-01-12 11:46:10.243000+01:00 [error] <0.475.0> BOOT FAILED
2025-01-12 11:46:10.243000+01:00 [error] <0.475.0> ===========
2025-01-12 11:46:10.243000+01:00 [error] <0.475.0> Error during startup: {error,no_epmd_port}
2025-01-12 11:46:10.243000+01:00 [error] <0.475.0> 
2025-01-12 11:46:11.332000+01:00 [info] <0.475.0> Stopping RabbitMQ applications and their dependencies in the following order:
2025-01-12 11:46:11.332000+01:00 [info] <0.475.0>     rabbitmq_management
2025-01-12 11:46:11.332000+01:00 [info] <0.475.0>     rabbitmq_management_agent
2025-01-12 11:46:11.332000+01:00 [info] <0.475.0>     rabbitmq_web_dispatch
2025-01-12 11:46:11.332000+01:00 [info] <0.475.0>     cowboy
2025-01-12 11:46:11.332000+01:00 [info] <0.475.0>     cowlib
2025-01-12 11:46:11.332000+01:00 [info] <0.475.0>     rabbit
2025-01-12 11:46:11.332000+01:00 [info] <0.475.0>     rabbitmq_prelaunch
2025-01-12 11:46:11.332000+01:00 [info] <0.475.0>     oauth2_client
2025-01-12 11:46:11.332000+01:00 [info] <0.475.0>     amqp_client
2025-01-12 11:46:11.332000+01:00 [info] <0.475.0>     rabbit_common
2025-01-12 11:46:11.332000+01:00 [info] <0.475.0>     jose
2025-01-12 11:46:11.332000+01:00 [info] <0.475.0>     khepri
2025-01-12 11:46:11.332000+01:00 [info] <0.475.0>     ra
2025-01-12 11:46:11.332000+01:00 [info] <0.475.0>     os_mon
2025-01-12 11:46:11.332000+01:00 [info] <0.475.0>     sysmon_handler
2025-01-12 11:46:11.332000+01:00 [info] <0.475.0>     osiris
2025-01-12 11:46:11.332000+01:00 [info] <0.475.0>     mnesia
2025-01-12 11:46:11.332000+01:00 [info] <0.475.0> 
2025-01-12 11:46:11.332000+01:00 [info] <0.475.0> Stopping application 'rabbitmq_management'
2025-01-12 11:46:11.334000+01:00 [warning] <0.491.0> HTTP listener registry could not find context rabbitmq_management_tls
2025-01-12 11:46:11.341000+01:00 [notice] <0.45.0> Application rabbitmq_management exited with reason: stopped
2025-01-12 11:46:11.341000+01:00 [info] <0.475.0> Stopping application 'rabbitmq_management_agent'
2025-01-12 11:46:11.347000+01:00 [notice] <0.45.0> Application rabbitmq_management_agent exited with reason: stopped
2025-01-12 11:46:11.347000+01:00 [info] <0.475.0> Stopping application 'rabbitmq_web_dispatch'
2025-01-12 11:46:11.354000+01:00 [notice] <0.45.0> Application rabbitmq_web_dispatch exited with reason: stopped
2025-01-12 11:46:11.354000+01:00 [info] <0.475.0> Stopping application 'cowboy'
2025-01-12 11:46:11.360000+01:00 [notice] <0.45.0> Application cowboy exited with reason: stopped
2025-01-12 11:46:11.360000+01:00 [info] <0.475.0> Stopping application 'cowlib'
2025-01-12 11:46:11.360000+01:00 [notice] <0.45.0> Application cowlib exited with reason: stopped
2025-01-12 11:46:11.360000+01:00 [info] <0.475.0> Stopping application 'rabbit'
2025-01-12 11:46:11.361000+01:00 [info] <0.415.0> Virtual host '/' is stopping
2025-01-12 11:46:11.361000+01:00 [info] <0.572.0> Closing all connections in vhost '/' on node 'rabbit@mauro-dell7740' because the vhost is stopping
2025-01-12 11:46:11.361000+01:00 [info] <0.429.0> Stopping message store for directory 'c:/Users/mraym/AppData/Roaming/RabbitMQ/db/rabbit@mauro-dell7740-mnesia/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent'
2025-01-12 11:46:11.368000+01:00 [info] <0.429.0> Message store for directory 'c:/Users/mraym/AppData/Roaming/RabbitMQ/db/rabbit@mauro-dell7740-mnesia/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' is stopped
2025-01-12 11:46:11.368000+01:00 [info] <0.425.0> Stopping message store for directory 'c:/Users/mraym/AppData/Roaming/RabbitMQ/db/rabbit@mauro-dell7740-mnesia/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient'
2025-01-12 11:46:11.374000+01:00 [info] <0.425.0> Message store for directory 'c:/Users/mraym/AppData/Roaming/RabbitMQ/db/rabbit@mauro-dell7740-mnesia/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' is stopped
2025-01-12 11:46:11.388000+01:00 [notice] <0.45.0> Application rabbit exited with reason: stopped
2025-01-12 11:46:14.340000+01:00 [notice] <0.211.0> Logging: configured log handlers are now ACTIVE
2025-01-12 11:46:14.348000+01:00 [info] <0.211.0> ra: starting system quorum_queues
2025-01-12 11:46:14.348000+01:00 [info] <0.211.0> starting Ra system: quorum_queues in directory: c:/Users/mraym/AppData/Roaming/RabbitMQ/db/rabbit@mauro-dell7740-mnesia/quorum/rabbit@mauro-dell7740
2025-01-12 11:46:14.407000+01:00 [info] <0.225.0> ra system 'quorum_queues' running pre init for 0 registered servers
2025-01-12 11:46:14.418000+01:00 [info] <0.226.0> ra: meta data store initialised for system quorum_queues. 0 record(s) recovered
2025-01-12 11:46:14.432000+01:00 [notice] <0.231.0> WAL: ra_log_wal init, open tbls: ra_log_open_mem_tables, closed tbls: ra_log_closed_mem_tables
2025-01-12 11:46:14.459000+01:00 [info] <0.233.0> ra_system_recover: ra system 'quorum_queues' server recovery strategy rabbit_quorum_queue:system_recover
2025-01-12 11:46:14.459000+01:00 [info] <0.233.0> [rabbit_quorum_queue:system_recover/1] rabbit not booted, skipping queue recovery
2025-01-12 11:46:14.459000+01:00 [info] <0.211.0> ra: starting system coordination
2025-01-12 11:46:14.459000+01:00 [info] <0.211.0> starting Ra system: coordination in directory: c:/Users/mraym/AppData/Roaming/RabbitMQ/db/rabbit@mauro-dell7740-mnesia/coordination/rabbit@mauro-dell7740
2025-01-12 11:46:14.460000+01:00 [info] <0.239.0> ra system 'coordination' running pre init for 1 registered servers
2025-01-12 11:46:14.472000+01:00 [info] <0.240.0> ra: meta data store initialised for system coordination. 1 record(s) recovered
2025-01-12 11:46:14.472000+01:00 [notice] <0.245.0> WAL: ra_coordination_log_wal init, open tbls: ra_coordination_log_open_mem_tables, closed tbls: ra_coordination_log_closed_mem_tables
2025-01-12 11:46:14.487000+01:00 [info] <0.211.0> ra: starting system coordination
2025-01-12 11:46:14.487000+01:00 [info] <0.211.0> starting Ra system: coordination in directory: c:/Users/mraym/AppData/Roaming/RabbitMQ/db/rabbit@mauro-dell7740-mnesia/coordination/rabbit@mauro-dell7740
2025-01-12 11:46:14.801000+01:00 [notice] <0.250.0> RabbitMQ metadata store: candidate -> leader in term: 43 machine version: 1
2025-01-12 11:46:15.054000+01:00 [info] <0.211.0> 
2025-01-12 11:46:15.054000+01:00 [info] <0.211.0>  Starting RabbitMQ 4.0.5 on Erlang 27.2 [jit]
2025-01-12 11:46:15.054000+01:00 [info] <0.211.0>  Copyright (c) 2007-2024 Broadcom Inc and/or its subsidiaries
2025-01-12 11:46:15.054000+01:00 [info] <0.211.0>  Licensed under the MPL 2.0. Website: https://rabbitmq.com
2025-01-12 11:46:15.055000+01:00 [info] <0.211.0> 
2025-01-12 11:46:15.055000+01:00 [info] <0.211.0>  node           : rabbit@mauro-dell7740
2025-01-12 11:46:15.055000+01:00 [info] <0.211.0>  home dir       : c:/WINDOWS/system32/config/systemprofile
2025-01-12 11:46:15.055000+01:00 [info] <0.211.0>  config file(s) : c:/Users/mraym/AppData/Roaming/RabbitMQ/advanced.config
2025-01-12 11:46:15.055000+01:00 [info] <0.211.0>  cookie hash    : GGwmaV3Gixv7FLg/mS6gPQ==
2025-01-12 11:46:15.055000+01:00 [info] <0.211.0>  log(s)         : <stdout>
2025-01-12 11:46:15.055000+01:00 [info] <0.211.0>                 : c:/Users/mraym/AppData/Roaming/RabbitMQ/log/[email protected]
2025-01-12 11:46:15.055000+01:00 [info] <0.211.0>  data dir       : c:/Users/mraym/AppData/Roaming/RabbitMQ/db/rabbit@mauro-dell7740-mnesia
2025-01-12 11:46:15.404000+01:00 [info] <0.211.0> Running boot step pre_boot defined by app rabbit
2025-01-12 11:46:15.404000+01:00 [info] <0.211.0> Running boot step rabbit_global_counters defined by app rabbit
2025-01-12 11:46:15.404000+01:00 [info] <0.211.0> Running boot step rabbit_osiris_metrics defined by app rabbit
2025-01-12 11:46:15.404000+01:00 [info] <0.211.0> Running boot step rabbit_core_metrics defined by app rabbit
2025-01-12 11:46:15.404000+01:00 [info] <0.211.0> Running boot step rabbit_alarm defined by app rabbit
2025-01-12 11:46:15.421000+01:00 [info] <0.341.0> Memory high watermark set to 9681 MiB (10152134246 bytes) of 16136 MiB (16920223744 bytes) total
2025-01-12 11:46:15.423000+01:00 [info] <0.343.0> Enabling free disk space monitoring (disk free space: 168976519168, total memory: 16920223744)
2025-01-12 11:46:15.423000+01:00 [info] <0.343.0> Disk free limit set to 50MB
2025-01-12 11:46:15.424000+01:00 [info] <0.211.0> Running boot step code_server_cache defined by app rabbit
2025-01-12 11:46:15.424000+01:00 [info] <0.211.0> Running boot step file_handle_cache defined by app rabbit
2025-01-12 11:46:15.431000+01:00 [info] <0.346.0> Limiting to approx 65439 file handles (58893 sockets)
2025-01-12 11:46:15.431000+01:00 [info] <0.347.0> FHC read buffering: OFF
2025-01-12 11:46:15.431000+01:00 [info] <0.347.0> FHC write buffering: ON
2025-01-12 11:46:15.431000+01:00 [info] <0.211.0> Running boot step worker_pool defined by app rabbit

Logs from node 2 (if applicable, with sensitive values edited out)

See https://www.rabbitmq.com/docs/logging to learn how to collect logs

# PASTE LOG HERE, BETWEEN BACKTICKS

Logs from node 3 (if applicable, with sensitive values edited out)

See https://www.rabbitmq.com/docs/logging to learn how to collect logs

# PASTE LOG HERE, BETWEEN BACKTICKS

rabbitmq.conf

NOT PRESENT

Steps to deploy RabbitMQ cluster

Execute Erlang installer then RabbitMQ installer

Steps to reproduce the behavior in question

Execute Erlang installer then RabbitMQ installer

advanced.config

[].

Application code

# PASTE CODE HERE, BETWEEN BACKTICKS

Kubernetes deployment file

# Relevant parts of K8S deployment that demonstrate how RabbitMQ is deployed
# PASTE YAML HERE, BETWEEN BACKTICKS

What problem are you trying to solve?

The service restart every 50 seconds and application fails open connection. The listening ports list is empty

[michaelklishin]

2025-01-12 11:46:10.243000+01:00 [error] <0.475.0> BOOT FAILED
2025-01-12 11:46:10.243000+01:00 [error] <0.475.0> ===========
2025-01-12 11:46:10.243000+01:00 [error] <0.475.0> Error during startup: {error,no_epmd_port}

RabbitMQ could not connect to its local epmd, almost certainly due to security tooling, anti-viruses of sorts. See what ports RabbitMQ uses and whitelist the node's data directory and all of those ports (at least for local connections, and if you need clustering, for remote ones as well).