Skip to content

Commit

Permalink
Add example for building an external secondary index for parquet files (
Browse files Browse the repository at this point in the history
#10549)

* Add example for building an external index for parquet filtes

* Use register_object_store api

* use FileScanConfig API

* Udpate to use new API

* Collapose `use` statements

* fix typo
  • Loading branch information
alamb authored May 31, 2024
1 parent 02a76da commit 09dde27
Show file tree
Hide file tree
Showing 2 changed files with 706 additions and 0 deletions.
1 change: 1 addition & 0 deletions datafusion-examples/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -60,6 +60,7 @@ cargo run --example csv_sql
- [`function_factory.rs`](examples/function_factory.rs): Register `CREATE FUNCTION` handler to implement SQL macros
- [`make_date.rs`](examples/make_date.rs): Examples of using the make_date function
- [`memtable.rs`](examples/memtable.rs): Create an query data in memory using SQL and `RecordBatch`es
- ['parquet_index.rs'](examples/parquet_index.rs): Create an secondary index over several parquet files and use it to speed up queries
- [`parquet_sql.rs`](examples/parquet_sql.rs): Build and run a query plan from a SQL statement against a local Parquet file
- [`parquet_sql_multiple_files.rs`](examples/parquet_sql_multiple_files.rs): Build and run a query plan from a SQL statement against multiple local Parquet files
- ['parquet_exec_visitor.rs'](examples/parquet_exec_visitor.rs): Extract statistics by visiting an ExecutionPlan after execution
Expand Down
Loading

0 comments on commit 09dde27

Please sign in to comment.