Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add statistics to Parquet execution plan #14

Open
rdettai opened this issue Feb 5, 2021 · 0 comments
Open

Add statistics to Parquet execution plan #14

rdettai opened this issue Feb 5, 2021 · 0 comments
Labels
enhancement New feature or request

Comments

@rdettai
Copy link
Contributor

rdettai commented Feb 5, 2021

The parquet execution plan used in Buzz (https://github.com/cloudfuse-io/buzz-rust/blob/master/code/src/execution_plan/parquet.rs) is a forked version of the one in DataFusion (https://github.com/apache/arrow/blob/master/rust/datafusion/src/physical_plan/parquet.rs).

The fork is outdated as DataFusion recently added the capability to read statistics from the parquet footer. The Buzz fork should thus be aligned to also support this functionality.

@rdettai rdettai added the enhancement New feature or request label Feb 5, 2021
@rdettai rdettai changed the title Add statistics to Parquer execution plan Add statistics to Parquet execution plan Feb 15, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant