You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
For .snappy.parquet files written to S3 when calling wr.s3.to_parquet with the database option:
I'm trying to get these files from S3 and access the records inside from a nodejs process, but the libraries I'm using are all throwing errors. I've also tried using snzip to decompress the snappy file and that also failed.
Is there something special about the parquet files written by wrangler that deviates from the snappy/parquet standard spec? Or is there a problem with the nodejs libraries and/or snzip CLI tool?
The nodejs libraries I've tried are: parquetjsparquetssnappy and snappyjs
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
For .snappy.parquet files written to S3 when calling
wr.s3.to_parquet
with thedatabase
option:I'm trying to get these files from S3 and access the records inside from a nodejs process, but the libraries I'm using are all throwing errors. I've also tried using
snzip
to decompress the snappy file and that also failed.Is there something special about the parquet files written by wrangler that deviates from the snappy/parquet standard spec? Or is there a problem with the nodejs libraries and/or
snzip
CLI tool?The nodejs libraries I've tried are:
parquetjs
parquets
snappy
andsnappyjs
Beta Was this translation helpful? Give feedback.
All reactions