Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Website: Add blog post for 18.0.0 #547

Merged
merged 13 commits into from
Nov 5, 2024
Merged

Website: Add blog post for 18.0.0 #547

Changes from 2 commits
Commits
Show all changes
13 commits
Select commit Hold shift + click to select a range
eb01372
Website: Add blog post for 18.0.0
raulcd Oct 10, 2024
85d1669
Update URLs for 18.0.0
raulcd Oct 10, 2024
0abdbec
Add Linux packages note.
kou Oct 11, 2024
28ab22b
Add GLib notes
kou Oct 11, 2024
157c76d
Add Ruby notes
kou Oct 11, 2024
eb6dc86
Apply several release notes from review
raulcd Oct 11, 2024
0ef7e04
Add C++ and format notes
pitrou Oct 14, 2024
3bc8b43
Update _posts/2024-10-16-18.0.0-release.md
jorisvandenbossche Oct 24, 2024
419e00b
Improve description of S3 single API call upload
pitrou Oct 24, 2024
cb768a0
Typo
pitrou Oct 24, 2024
86957b9
Add link to env var
pitrou Oct 24, 2024
525cb79
Update _posts/2024-10-16-18.0.0-release.md
raulcd Oct 24, 2024
dc9c19d
Update final date, add final number of commits, committers and some m…
raulcd Nov 5, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
121 changes: 121 additions & 0 deletions _posts/2024-10-16-18.0.0-release.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,121 @@
---
layout: post
title: "Apache Arrow 18.0.0 Release"
date: "2024-10-16 00:00:00"
author: pmc
categories: [release]
---
<!--
{% comment %}
Licensed to the Apache Software Foundation (ASF) under one or more
contributor license agreements. See the NOTICE file distributed with
this work for additional information regarding copyright ownership.
The ASF licenses this file to you under the Apache License, Version 2.0
(the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
{% endcomment %}
-->


The Apache Arrow team is pleased to announce the 18.0.0 release. This covers
over 3 months of development work and includes [**XXX resolved issues**][1]
on [**YYY distinct commits**][2] from [**ZZZ distinct contributors**][2].
See the [Install Page](https://arrow.apache.org/install/)
to learn how to get the libraries for your platform.

The release notes below are not exhaustive and only expose selected highlights
of the release. Many other bugfixes and improvements have been made: we refer
you to the [complete changelog][3].

## Community

Since the 17.0.0 release, JJJJJ has been invited to be committer.
raulcd marked this conversation as resolved.
Show resolved Hide resolved
No new members have joined the Project Management Committee (PMC).

Thanks for your contributions and participation in the project!

## Linux packages notes

kou marked this conversation as resolved.
Show resolved Hide resolved

## C Data Interface notes

pitrou marked this conversation as resolved.
Show resolved Hide resolved

## Arrow Flight RPC notes

raulcd marked this conversation as resolved.
Show resolved Hide resolved

## C++ notes

For C++ notes refer to the full changelog.

### Highlights

pitrou marked this conversation as resolved.
Show resolved Hide resolved

### Acero

raulcd marked this conversation as resolved.
Show resolved Hide resolved
raulcd marked this conversation as resolved.
Show resolved Hide resolved

### Compute


### Dataset


### Filesystems


### GPU


### IPC


### Parquet


### Substrait


## C# notes

raulcd marked this conversation as resolved.
Show resolved Hide resolved

raulcd marked this conversation as resolved.
Show resolved Hide resolved
## Java notes

raulcd marked this conversation as resolved.
Show resolved Hide resolved

## JavaScript notes

raulcd marked this conversation as resolved.
Show resolved Hide resolved

## Python notes

jorisvandenbossche marked this conversation as resolved.
Show resolved Hide resolved

## R notes

For more on what’s in the 18.0.0 R package, see the [R changelog][4].
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@jonkeane @paleolimbot @assignUser can you help with the R notes?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
## R notes
For more on what’s in the 18.0.0 R package, see the [R changelog][4].
## R notes
* R functions that users write that use functions that Arrow supports in dataset
queries now can be used in queries too. Previously, only functions that used
arithmetic operators worked.
For example, `time_hours <- function(mins) mins / 60` worked,
but `time_hours_rounded <- function(mins) round(mins / 60)` did not;
now both work. These are automatic translations rather than true user-defined
functions (UDFs); for UDFs, see `register_scalar_function()`. [GH-41223](https://github.com/apache/arrow/issues/41223)
* `mutate()` expressions can now include aggregations, such as `x - mean(x)`. [GH-41350](https://github.com/apache/arrow/issues/41350)
* `summarize()` supports more complex expressions, and correctly handles cases
where column names are reused in expressions. [GH-41223](https://github.com/apache/arrow/issues/41223)
* The `na_matches` argument to the `dplyr::*_join()` functions is now supported.
This argument controls whether `NA` values are considered equal when joining. [GH-41358](https://github.com/apache/arrow/issues/41358)
* R metadata, stored in the Arrow schema to support round-tripping data between
R and Arrow/Parquet, is now serialized and deserialized more strictly.
This makes it safer to load data from files from unknown sources into R data.frames. [GH-41969](https://github.com/apache/arrow/issues/41969)
* Turn on the S3 and ZSTD features by default for macOS. [GH-42210](https://github.com/apache/arrow/issues/42210)
* Fix a bug in our implementation of `pull` on grouped datasets, it now
returns the expected column. [GH-43172](https://github.com/apache/arrow/issues/43172)
For full details of what’s in the 18.0.0 R package, see the [R changelog][4].

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@jonkeane these are the 17.0.0 changes though right?

Nic and I are working on a NEWS.md patch in apache/arrow#44496 and we can copy that in here in a bit.


## Ruby and C GLib notes

kou marked this conversation as resolved.
Show resolved Hide resolved
### Ruby

kou marked this conversation as resolved.
Show resolved Hide resolved
### C GLib

kou marked this conversation as resolved.
Show resolved Hide resolved

## Rust notes and Go notes

The Rust and Go projects have moved to separate repositories outside the
main Arrow monorepo. For notes on the latest release of the Rust
implementation, see the latest [Arrow Rust changelog][5].
For notes on the latest release of the Go implementation, see the latest
[Arrow Go changelog][6]
raulcd marked this conversation as resolved.
Show resolved Hide resolved

[1]: https://github.com/apache/arrow/milestone/64?closed=1
[2]: {{ site.baseurl }}/release/18.0.0.html#contributors
[3]: {{ site.baseurl }}/release/18.0.0.html#changelog
[4]: {{ site.baseurl }}/docs/r/news/
[5]: https://github.com/apache/arrow-rs/tags
[6]: https://github.com/apache/arrow-go/tags