-
Notifications
You must be signed in to change notification settings - Fork 1.5k
Upgrade to arrow 15 #2631
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Upgrade to arrow 15 #2631
Conversation
31c8cd3
to
c09bf2a
Compare
c09bf2a
to
0d7b45f
Compare
@@ -365,7 +365,7 @@ mod tests { | |||
let expected = Statistics { | |||
is_exact: true, | |||
num_rows: Some(3), | |||
total_byte_size: Some(416), // this might change a bit if the way we compute the size changes | |||
total_byte_size: Some(464), // this might change a bit if the way we compute the size changes |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The changes to DataType have made it bigger, I don't think this is a problem
FWIW arrow 15 is now released apache/arrow-rs#1727 |
Currently blocked on apache/datafusion-ballista#48 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thank you @tustvold
🎉 |
Which issue does this PR close?
Closes #2530
Closes #2453
Rationale for this change
Arrow 15 contains breaking changes, lets validate them prior to release.
What changes are included in this PR?
Updates to the current arrow-rs master
Are there any user-facing changes?
No
Does this PR break compatibility with Ballista?
Possibly, I think I need to modify ballista to use the re-exports from Datafusion