Can vector sink data to HDFS/Hadoop ?

[Rattnik]

Hi,
Now we use Flume to consume data from kafka and send it to HDFS. But we want use Vector for that task, because we do that in other cases and Vector is better than Flume.
Is it possible to do that?

[jszwedko]

Hi @Rattnik !

Would you want to use WebHDFS to write data to HDFS? I'm not super familiar with HDFS, but I see this is how fluentd supports it.

[Rattnik]

Hi,
Yep, fluetnd supports it. but I wanted to know if it supports by Vector? If not, we will use Flume or fluentd.

Thanks!

[jszwedko]

Hi @Rattnik . Vector does not currently support it, but if WebHDFS would work for you, I'll open an issue.

[Rattnik]

Hi @jszwedko
it will be very kind of you and we will gladly use the Vector for sync data to hdfs.
Thanks!!!

[jszwedko]

Opened issue here: #7557 (comment)