Skip to content

A really simple example of using arrow_convert to write structs to parquet, and to then read parquet back to structs.

License

Notifications You must be signed in to change notification settings

andrew-rj/arrow-convert-example

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 

Repository files navigation

arrow-convert-example

A really simple example of using arrow_convert to write structs to parquet, and to then read parquet back to structs.

Currently, the main function writes out hardcoded data to a parquet file of your choosing. The file will be in the project root. There is then a test that will attempt to read a file (hardcoded to "test.parquet") and convert it to the same structure vec that the main function used, and assert that they are equal.

This isn't pretty, and I'm not quite sure that I will improve it at this point. This was used to figure out how to write complex structs to parquet and then to be able read them back into the same structs.

About

A really simple example of using arrow_convert to write structs to parquet, and to then read parquet back to structs.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published