New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FEA] HDFS Support in Tools #1304

Open

5 of 8 tasks

parthosa opened this issue Aug 20, 2024 · 0 comments

Assignees

Labels

feature request user_tools

Collaborator

parthosa commented Aug 20, 2024 •

edited by amahussein

Loading

Currently, tools has limited support for HDFS (event logs in hdfs need namenode URI, writing to hdfs output folder is not supported).

Tasks

Beta Give feedback

[BUG] Error when platform is unspecified as onprem with hdfs input paths #1283

bug user_tools
[BUG] Namenode URI should not be required when processing HDFS event logs #1253

bug core_tools user_tools
[BUG] user_tools fails to pick up hadoop_conf_dir when reading from hdfs #1302

bug user_tools
[BUG] python --output_folder doesn't have what filesystems are supported #1303

bug user_tools
Use StorageLib to download dependencies #1383

dependencies user_tools
the worker_info passed to the tools should define a URI to differentiate between localFS and DFS
Update the docs to explain that remote folders may not be accepted anymore
[FEA] Tool output file support for writing to HDFS file system #1348

feature request user_tools
Options

parthosa added feature request ? - Needs Triage labels

amahussein added user_tools and removed ? - Needs Triage labels

amahussein mentioned this issue

Append HADOOP_CONF_DIR to the tools CLASSPATH execution cmd #1308

Merged

mattahrens assigned tgravescs and amahussein

wjxiz1992 mentioned this issue

[FEA] Tool output file support for writing to HDFS file system #1348

Open

tgravescs removed their assignment

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment