Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

1st Slave produces an Error on start up #40

Closed
rockrabbit opened this issue Feb 26, 2025 · 7 comments
Closed

1st Slave produces an Error on start up #40

rockrabbit opened this issue Feb 26, 2025 · 7 comments
Labels
bug Something isn't working

Comments

@rockrabbit
Copy link

this is an odd one as this error doesn't always show up on cron sync but its the only one.

It's a Pi 4

ERR Sync failed error="sync configs: http://10.0.0.200/api/config: Patch "http://10.0.0.200/api/config\": dial tcp 10.0.0.200:80: connect: connection refused"

Does not happen all the time, just here and there... any ideas?

@rockrabbit
Copy link
Author

Image

Random!

@rockrabbit
Copy link
Author

2025-02-27T23:47:30Z FTL Sync failed error="sync configs: http://10.0.0.101/api/config: Patch "http://10.0.0.101/api/config\": dial tcp 10.0.0.101:80: connect: connection refused"

changed the order.. its the first Slave that's gets the error!

@rockrabbit rockrabbit changed the title Random Error in logs 1st Slave produces an Error on start up Feb 28, 2025
@rockrabbit
Copy link
Author

pi@200:~/nebula_beta $ docker logs 28caabf7ff70
2025-02-28T00:36:34Z INF Starting nebula-sync v0.3.0
2025-02-28T00:36:34Z INF Running manual sync replicas=5
2025-02-28T00:36:34Z INF Authenticating clients...
2025-02-28T00:36:34Z INF Syncing Teleporters...
2025-02-28T00:36:34Z INF Syncing configs...
2025-02-28T00:36:34Z FTL Sync failed error="sync configs: http://10.0.0.250/api/config: Patch "http://10.0.0.250/api/config\": dial tcp 10.0.0.250:80: connect: connection refused"

tried another.. first slave gets the error and shuts down Nebula

@lovelaze
Copy link
Owner

It seems like the teleport import and/or config patch sometimes require a restart and that will render the API unresponsive temporarily. pi-hole/FTL#2301

We will have to figure out a way to "healthcheck" the pihole or (hopefully not) just simply wait a bit before making consecutive requests.

@lovelaze lovelaze added the bug Something isn't working label Feb 28, 2025
@rockrabbit
Copy link
Author

pi-hole/FTL#2301 (comment)

use /Auth

@lovelaze
Copy link
Owner

lovelaze commented Mar 2, 2025

@rockrabbit This should be fixed now: #51

I went with a naive retry solution, it will attempt to retry at most X times with a delay in between. I think this should be good enough, but might want to implement a real health check in the future.

@rockrabbit
Copy link
Author

2025-03-02T11:43:22Z INF Starting nebula-sync v0.4.1
2025-03-02T11:43:22Z INF Running manual sync replicas=5
2025-03-02T11:43:22Z INF Authenticating clients...
2025-03-02T11:43:22Z INF Syncing Teleporters...
2025-03-02T11:43:23Z INF Syncing configs...
2025-03-02T11:43:27Z INF Invalidating sessions...
2025-03-02T11:43:27Z INF Sync complete

Love it! Appears to be fixed! Thank you!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants