Skip to content

Commit

Permalink
Test Python 3.12 compatibility
Browse files Browse the repository at this point in the history
  • Loading branch information
dolfinus committed Oct 3, 2023
1 parent 327fde3 commit f9f4cdd
Show file tree
Hide file tree
Showing 19 changed files with 34 additions and 34 deletions.
4 changes: 2 additions & 2 deletions .github/workflows/data/clickhouse/matrix.yml
Original file line number Diff line number Diff line change
Expand Up @@ -6,13 +6,13 @@ min: &min

max: &max
spark-version: 3.5.0
python-version: '3.11'
python-version: '3.12'
java-version: 20
os: ubuntu-latest

latest: &latest
spark-version: latest
python-version: '3.11'
python-version: '3.12'
java-version: 20
os: ubuntu-latest

Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/data/core/matrix.yml
Original file line number Diff line number Diff line change
Expand Up @@ -6,13 +6,13 @@ min: &min

max: &max
spark-version: 3.5.0
python-version: '3.11'
python-version: '3.12'
java-version: 20
os: ubuntu-latest

latest: &latest
spark-version: latest
python-version: '3.11'
python-version: '3.12'
java-version: 20
os: ubuntu-latest

Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/data/ftp/matrix.yml
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@ min: &min
os: ubuntu-latest

max: &max
python-version: '3.11'
python-version: '3.12'
os: ubuntu-latest

matrix:
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/data/ftps/matrix.yml
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@ min: &min
os: ubuntu-latest

max: &max
python-version: '3.11'
python-version: '3.12'
os: ubuntu-latest

matrix:
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/data/hdfs/matrix.yml
Original file line number Diff line number Diff line change
Expand Up @@ -8,14 +8,14 @@ min: &min
max: &max
hadoop-version: hadoop3-hdfs
spark-version: 3.5.0
python-version: '3.11'
python-version: '3.12'
java-version: 20
os: ubuntu-latest

latest: &latest
hadoop-version: hadoop3-hdfs
spark-version: latest
python-version: '3.11'
python-version: '3.12'
java-version: 20
os: ubuntu-latest

Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/data/hive/matrix.yml
Original file line number Diff line number Diff line change
Expand Up @@ -6,13 +6,13 @@ min: &min

max: &max
spark-version: 3.5.0
python-version: '3.11'
python-version: '3.12'
java-version: 20
os: ubuntu-latest

latest: &latest
spark-version: latest
python-version: '3.11'
python-version: '3.12'
java-version: 20
os: ubuntu-latest

Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/data/kafka/matrix.yml
Original file line number Diff line number Diff line change
Expand Up @@ -9,14 +9,14 @@ min: &min
max: &max
kafka-version: 3.5.1
spark-version: 3.5.0
python-version: '3.11'
python-version: '3.12'
java-version: 20
os: ubuntu-latest

latest: &latest
kafka-version: latest
spark-version: latest
python-version: '3.11'
python-version: '3.12'
java-version: 20
os: ubuntu-latest

Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/data/local-fs/matrix.yml
Original file line number Diff line number Diff line change
Expand Up @@ -18,13 +18,13 @@ min_excel: &min_excel

max: &max
spark-version: 3.4.1
python-version: '3.11'
python-version: '3.12'
java-version: 20
os: ubuntu-latest

latest: &latest
spark-version: latest
python-version: '3.11'
python-version: '3.12'
java-version: 20
os: ubuntu-latest

Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/data/mongodb/matrix.yml
Original file line number Diff line number Diff line change
Expand Up @@ -7,13 +7,13 @@ min: &min

max: &max
spark-version: 3.4.1
python-version: '3.11'
python-version: '3.12'
java-version: 20
os: ubuntu-latest

latest: &latest
spark-version: latest
python-version: '3.11'
python-version: '3.12'
java-version: 20
os: ubuntu-latest

Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/data/mssql/matrix.yml
Original file line number Diff line number Diff line change
Expand Up @@ -6,13 +6,13 @@ min: &min

max: &max
spark-version: 3.5.0
python-version: '3.11'
python-version: '3.12'
java-version: 20
os: ubuntu-latest

latest: &latest
spark-version: latest
python-version: '3.11'
python-version: '3.12'
java-version: 20
os: ubuntu-latest

Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/data/mysql/matrix.yml
Original file line number Diff line number Diff line change
Expand Up @@ -6,13 +6,13 @@ min: &min

max: &max
spark-version: 3.5.0
python-version: '3.11'
python-version: '3.12'
java-version: 20
os: ubuntu-latest

latest: &latest
spark-version: latest
python-version: '3.11'
python-version: '3.12'
java-version: 20
os: ubuntu-latest

Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/data/oracle/matrix.yml
Original file line number Diff line number Diff line change
Expand Up @@ -6,13 +6,13 @@ min: &min

max: &max
spark-version: 3.5.0
python-version: '3.11'
python-version: '3.12'
java-version: 20
os: ubuntu-latest

latest: &latest
spark-version: latest
python-version: '3.11'
python-version: '3.12'
java-version: 20
os: ubuntu-latest

Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/data/postgres/matrix.yml
Original file line number Diff line number Diff line change
Expand Up @@ -6,13 +6,13 @@ min: &min

max: &max
spark-version: 3.5.0
python-version: '3.11'
python-version: '3.12'
java-version: 20
os: ubuntu-latest

latest: &latest
spark-version: latest
python-version: '3.11'
python-version: '3.12'
java-version: 20
os: ubuntu-latest

Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/data/s3/matrix.yml
Original file line number Diff line number Diff line change
Expand Up @@ -10,14 +10,14 @@ min: &min
max: &max
minio-version: 2023.7.18
spark-version: 3.5.0
python-version: '3.11'
python-version: '3.12'
java-version: 20
os: ubuntu-latest

latest: &latest
minio-version: latest
spark-version: latest
python-version: '3.11'
python-version: '3.12'
java-version: 20
os: ubuntu-latest

Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/data/samba/matrix.yml
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@ min: &min
os: ubuntu-latest

max: &max
python-version: '3.11'
python-version: '3.12'
os: ubuntu-latest

matrix:
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/data/sftp/matrix.yml
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@ min: &min
os: ubuntu-latest

max: &max
python-version: '3.11'
python-version: '3.12'
os: ubuntu-latest

matrix:
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/data/teradata/matrix.yml
Original file line number Diff line number Diff line change
@@ -1,12 +1,12 @@
max: &max
spark-version: 3.5.0
python-version: '3.11'
python-version: '3.12'
java-version: 20
os: ubuntu-latest

latest: &latest
spark-version: latest
python-version: '3.11'
python-version: '3.12'
java-version: 20
os: ubuntu-latest

Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/data/webdav/matrix.yml
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@ min: &min
os: ubuntu-latest

max: &max
python-version: '3.11'
python-version: '3.12'
os: ubuntu-latest

matrix:
Expand Down
6 changes: 3 additions & 3 deletions README.rst
Original file line number Diff line number Diff line change
Expand Up @@ -51,7 +51,7 @@ Non-goals

Requirements
------------
* **Python 3.7 - 3.11**
* **Python 3.7 - 3.12**
* PySpark 2.3.x - 3.5.x (depends on used connector)
* Java 8+ (required by Spark, see below)
* Kerberos libs & GCC (required by ``Hive``, ``HDFS`` and ``SparkHDFS`` connectors)
Expand Down Expand Up @@ -177,9 +177,9 @@ Compatibility matrix
+--------------------------------------------------------------+-------------+-------------+-------+
| `3.3.x <https://spark.apache.org/docs/3.3.3/#downloading>`_ | 3.7 - 3.10 | 8u201 - 17 | 2.12 |
+--------------------------------------------------------------+-------------+-------------+-------+
| `3.4.x <https://spark.apache.org/docs/3.4.1/#downloading>`_ | 3.7 - 3.11 | 8u362 - 20 | 2.12 |
| `3.4.x <https://spark.apache.org/docs/3.4.1/#downloading>`_ | 3.7 - 3.12 | 8u362 - 20 | 2.12 |
+--------------------------------------------------------------+-------------+-------------+-------+
| `3.5.x <https://spark.apache.org/docs/3.5.0/#downloading>`_ | 3.8 - 3.11 | 8u371 - 20 | 2.12 |
| `3.5.x <https://spark.apache.org/docs/3.5.0/#downloading>`_ | 3.8 - 3.12 | 8u371 - 20 | 2.12 |
+--------------------------------------------------------------+-------------+-------------+-------+

.. _pyspark-install:
Expand Down

0 comments on commit f9f4cdd

Please sign in to comment.