Skip to content

Commit 15732fc

Browse files
committed
[SPARK-51950][BUILD] Upgrade Parquet to 1.15.2
### What changes were proposed in this pull request? This PR aims to upgrade `Parquet` to 1.15.2. ### Why are the changes needed? To bring the latest bug fixes. - https://parquet.apache.org/blog/2025/05/01/1.15.2/ - https://github.com/apache/parquet-java/releases/tag/apache-parquet-1.15.2 ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Pass the CIs. ### Was this patch authored or co-authored using generative AI tooling? No. Closes #50755 from dongjoon-hyun/SPARK-51950. Authored-by: Dongjoon Hyun <[email protected]> Signed-off-by: Dongjoon Hyun <[email protected]>
1 parent 98c44d0 commit 15732fc

File tree

3 files changed

+8
-8
lines changed

3 files changed

+8
-8
lines changed

dev/deps/spark-deps-hadoop-3-hive-2.3

+6-6
Original file line numberDiff line numberDiff line change
@@ -242,12 +242,12 @@ orc-shims/2.1.1//orc-shims-2.1.1.jar
242242
oro/2.0.8//oro-2.0.8.jar
243243
osgi-resource-locator/1.0.3//osgi-resource-locator-1.0.3.jar
244244
paranamer/2.8//paranamer-2.8.jar
245-
parquet-column/1.15.1//parquet-column-1.15.1.jar
246-
parquet-common/1.15.1//parquet-common-1.15.1.jar
247-
parquet-encoding/1.15.1//parquet-encoding-1.15.1.jar
248-
parquet-format-structures/1.15.1//parquet-format-structures-1.15.1.jar
249-
parquet-hadoop/1.15.1//parquet-hadoop-1.15.1.jar
250-
parquet-jackson/1.15.1//parquet-jackson-1.15.1.jar
245+
parquet-column/1.15.2//parquet-column-1.15.2.jar
246+
parquet-common/1.15.2//parquet-common-1.15.2.jar
247+
parquet-encoding/1.15.2//parquet-encoding-1.15.2.jar
248+
parquet-format-structures/1.15.2//parquet-format-structures-1.15.2.jar
249+
parquet-hadoop/1.15.2//parquet-hadoop-1.15.2.jar
250+
parquet-jackson/1.15.2//parquet-jackson-1.15.2.jar
251251
pickle/1.5//pickle-1.5.jar
252252
py4j/0.10.9.9//py4j-0.10.9.9.jar
253253
remotetea-oncrpc/1.1.2//remotetea-oncrpc-1.1.2.jar

examples/src/main/python/parquet_inputformat.py

+1-1
Original file line numberDiff line numberDiff line change
@@ -19,7 +19,7 @@
1919
Read data file users.parquet in local Spark distro:
2020
2121
$ cd $SPARK_HOME
22-
$ export AVRO_PARQUET_JARS=/path/to/parquet-avro-1.15.1.jar
22+
$ export AVRO_PARQUET_JARS=/path/to/parquet-avro-1.15.2.jar
2323
$ ./bin/spark-submit --driver-class-path /path/to/example/jar \\
2424
--jars $AVRO_PARQUET_JARS \\
2525
./examples/src/main/python/parquet_inputformat.py \\

pom.xml

+1-1
Original file line numberDiff line numberDiff line change
@@ -137,7 +137,7 @@
137137
<kafka.version>3.9.0</kafka.version>
138138
<!-- After 10.17.1.0, the minimum required version is JDK19 -->
139139
<derby.version>10.16.1.1</derby.version>
140-
<parquet.version>1.15.1</parquet.version>
140+
<parquet.version>1.15.2</parquet.version>
141141
<orc.version>2.1.1</orc.version>
142142
<orc.classifier>shaded-protobuf</orc.classifier>
143143
<jetty.version>11.0.25</jetty.version>

0 commit comments

Comments
 (0)