Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature request] Journal forwarding from remote instances #23

Open
ghost opened this issue Apr 9, 2019 · 4 comments
Open

[Feature request] Journal forwarding from remote instances #23

ghost opened this issue Apr 9, 2019 · 4 comments

Comments

@ghost
Copy link

ghost commented Apr 9, 2019

It would be great to have such a feature, when netlogd forwards /var/log/journal/remote messages.

@ssahani
Copy link
Collaborator

ssahani commented Apr 9, 2019

What is the use case of this ?

@ghost
Copy link
Author

ghost commented Apr 11, 2019

Let's assume we want to create some centralised log collection from multiple docker-enabled hosts. For convenience we have to use journald logging driver on every docker host (or docker logs won't work locally). So, now we have multiple options: to send journald logs to some journald-enabled host, to pass journald to local syslog and send them via syslog proto or to install (build on every host as no distributions provide corresponding package atm) netlogd on every machine. For me the best option is to pass all the logs as is to centralised journald and, from there to pass them on for analysis via standard syslog (netlogd is extremely helpful here). So if it's possible pass all collected logs from all the hosts via syslog/netlogd, it would be great!

@ssahani
Copy link
Collaborator

ssahani commented Apr 12, 2019

/var/log/journal/remote is created by systemd-journal-remote which is a extra package. If I get this right

H1 --------------------------->---------|
H2 ------------------------->-----------| CH---------------------- centralised syslog
H3---------------------->----------------|

why not directly store and eliminate the centralised journald. In that way you don;t need a centralized
journald-remote.

H1 --------------------------->---------
H2 ------------------------->----------- centralised syslog
H3---------------------->----------------

@ghost
Copy link
Author

ghost commented Apr 12, 2019

It's mostly about protocols. In my case, all the analytics are bound to syslog... So it's either netlogd on every machine (additional build-time deps, build is slightly distro-dependent) or local forwarding docker journald driver->journald->syslog->syslog-remote. Centralized storage with journald seems a little bit more convenient for me-almost no setup on each node, journald-remote is in every distro's repo, http transport. There is no doubt, there are other options to achieve what I'm looking for, but it would be easier imo with a nice little tool like netlogd. Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

No branches or pull requests

1 participant