Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add an option to skip the header check when reading Parquet files #18083

Draft
wants to merge 15 commits into
base: branch-25.04
Choose a base branch
from
Draft

Add an option to skip the header check when reading Parquet files #18083

wants to merge 15 commits into from

Conversation

vuule
Copy link
Contributor

@vuule vuule commented Feb 25, 2025 •
edited
Loading

Description

Reading the header is not very cheap when remote storage is used. This adds an option to skip this step.

Checklist

  • I am familiar with the Contributing Guidelines.
  • New or existing tests cover these changes.
  • The documentation is up to date with these changes.

@copy-pr-bot copy-pr-bot
Copy link

copy-pr-bot bot commented Feb 25, 2025

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

@vuule vuule self-assigned this Feb 25, 2025
@github-actions github-actions bot added libcudf Affects libcudf (C++/CUDA) code. Python Affects Python cuDF API. labels Feb 25, 2025
@vuule vuule added feature request New feature or request non-breaking Non-breaking change labels Feb 25, 2025
@github-actions github-actions bot added the pylibcudf Issues specific to the pylibcudf package label Feb 25, 2025
@vuule
Copy link
Contributor Author

vuule commented Feb 25, 2025

/ok to test

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@galipremsagar galipremsagar galipremsagar left review comments

At least 1 approving review is required to merge this pull request.

Assignees

@galipremsagar galipremsagar

@vuule vuule

Labels
feature request New feature or request libcudf Affects libcudf (C++/CUDA) code. non-breaking Non-breaking change pylibcudf Issues specific to the pylibcudf package Python Affects Python cuDF API.
Projects
cuDF Python
Status: No status
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@vuule @galipremsagar