-
Issue descriptionI am loading the file from Azure blob and want to avoid copying the entire content over and get a seekable stream. Also want to avoid loading the file into memory. Is there a forward only reader that does not need a seekable stream? |
Beta Was this translation helpful? Give feedback.
Answered by
aloneguid
Jan 30, 2025
Replies: 1 comment
-
Unfortunately, parquet metadata required to read the file is located at the end of the stream, because parquet format is optimised for writing, therefore we can't process forward-only streams. |
Beta Was this translation helpful? Give feedback.
0 replies
Answer selected by
aloneguid
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Unfortunately, parquet metadata required to read the file is located at the end of the stream, because parquet format is optimised for writing, therefore we can't process forward-only streams.