-
As I can see for column reader, it is only possible to read physical data without its logical type representation. If I don't want to use arrow and want to simply use parquet, how can I read logical types then? |
Beta Was this translation helpful? Give feedback.
Answered by
tustvold
Apr 19, 2024
Replies: 1 comment 3 replies
-
You will need to interpret the logic type information encoded in the schema manually. I would strongly encourage using arrow, which handles this and other record shredding for you (among other things), it will be an easier experience and the resulting code will likely be faster |
Beta Was this translation helpful? Give feedback.
3 replies
Answer selected by
ftelnov
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
You will need to interpret the logic type information encoded in the schema manually. I would strongly encourage using arrow, which handles this and other record shredding for you (among other things), it will be an easier experience and the resulting code will likely be faster