Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: add basic compression configuration to write_parquet #459

Merged

Conversation

mesejo
Copy link
Contributor

@mesejo mesejo commented Aug 16, 2023

Which issue does this PR close?

Closes #116.

What changes are included in this PR?

Only compression for all columns was added, later we could a per column compression argument

Are there any user-facing changes?

Yes, two new parameters were added but this should be reflected automatically by Sphinx,

src/dataframe.rs Outdated Show resolved Hide resolved
@mesejo mesejo force-pushed the feat/add-compression-to-parquet-writer branch from 92bcf3c to e6296c8 Compare August 18, 2023 06:06
@andygrove andygrove merged commit 499f045 into apache:main Aug 22, 2023
11 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Support parquet WriterProperties
2 participants