Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The message in the chan is incomplete. #55

Open
GitHub007Dra opened this issue May 11, 2023 · 2 comments
Open

The message in the chan is incomplete. #55

GitHub007Dra opened this issue May 11, 2023 · 2 comments
Labels
bug Something isn't working

Comments

@GitHub007Dra
Copy link

Describe the bug
for example , if a log file is "abcd"
sometimes it can only collect "abc"
this is my code

tails, err := tail.TailFile(fileName, tail.Config{ ReOpen: true, Follow: true, Location: &tail.SeekInfo{Offset: 0, Whence: flag.Whence}, MustExist: false, Poll: false, })

Expected behaviour

To Reproduce
sry ,I have used this to collect over a million log entries, and only a few hundred of them are difficult to reproduce.

System information

  • tail version [v1.4.8]
  • OS: centos
  • Arch: [e.g. arm64]
@GitHub007Dra GitHub007Dra added the bug Something isn't working label May 11, 2023
@GitHub007Dra GitHub007Dra changed the title The message in the pipeline is incomplete. The message in the chan is incomplete. May 11, 2023
@szuro
Copy link

szuro commented Jan 17, 2024

I'm experiencing a similar issue.
In my case I'm tailing a fast-changing file with up to 4 milions of entries.
However it seems to me that this is more related to the speed at which the file is appended to, rather than the volume of the file itself.

  • Tail version: v1.4.8 and v1.4.11
  • OS: Ubuntu 20
  • Arch: x86_64

Edit:
Upon inspection, it seems that setting this might work: Tail.Config.CompleteLines = true

@szuro
Copy link

szuro commented Jan 18, 2024

After running with CompleteLines=true for >24h, I see no issues with incomplete lines.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants