Release v2023.10.1 of Athena Query Federation

This version includes improvements and bugfixes in some connectors. See here for changes since the last release.

Binary distribution of the SDK can be found here. For pre-built versions of the connector and UDF suite please:

1. Navigate to Serverless Application Repository and search for "athena-federation". Also check the checkbox labeled "Show apps that create custom IAM roles or resource policies".

2. Look for entries published by the "Amazon Athena Federation" author.

You can assert the validity of the binary distribution by comparing against the below cksums.

CheckSum	File
3004269374 551040	aws-athena-federation-sdk-2023.10.1.jar
405396809 27834365	aws-athena-federation-sdk-2023.10.1-withdep.jar

What's Changed

• .github/workflows/maven_push.yml enhancements (#1103)
• Merge pull request #1102 from awslabs/msk-pagination-get-splits
• Apply same diff to kafka
• Add pagination for MSK doGetSplits
• GCS connector fix for uploaded partition folder issue (#1099)
• Make source compatible with Java 8 (#1100)
• build(deps): bump google-cloud-resourcemanager from 1.13.0 to 1.14.0 (#1095)
• build(deps): bump jetty.version from 11.0.13 to 11.0.14 (#1094)
• build(deps): bump maven-compiler-plugin from 3.10.1 to 3.11.0 (#1093)
• build(deps-dev): bump equalsverifier from 3.13.2 to 3.14 (#1098)
• build(deps): bump aws-sdk.version from 1.12.415 to 1.12.420 (#1092)
• build(deps): bump aws-cdk.version from 1.194.0 to 1.195.0 (#1091)
• Get rid of environment variable mocking
• Refactor code to not use System.getenv directly
• build(deps-dev): bump log4j2Version from 2.19.0 to 2.20.0
• build(deps): bump spotbugs-annotations from RELEASE to 4.7.3
• build(deps): bump snakeyaml from 1.33 to 2.0
• build(deps): bump msal4j from 1.13.4 to 1.13.5
• build(deps): bump google-cloud-storage from 2.18.0 to 2.19.0
• build(deps): bump maven-assembly-plugin from 3.4.2 to 3.5.0
• build(deps): bump snowflake-jdbc from 3.13.27 to 3.13.28
• build(deps): bump ngdbc from 2.15.10 to 2.15.12
• build(deps): bump aws-cdk.version from 1.193.0 to 1.194.0
• build(deps): bump aws-sdk.version from 1.12.410 to 1.12.415
• build(deps): bump jsii-runtime from 1.75.0 to 1.76.0 (#1076)

Full Changelog: https://github.com/awslabs/aws-athena-query-federation/compare/v2023.8.3..v2023.10.1

Release v2023.8.3 of Athena Query Federation

This version includes improvements and bugfixes in some connectors. See here for changes since the last release.

Binary distribution of the SDK can be found here. For pre-built versions of the connector and UDF suite please:

1. Navigate to Serverless Application Repository and search for "athena-federation". Also check the checkbox labeled "Show apps that create custom IAM roles or resource policies".

2. Look for entries published by the "Amazon Athena Federation" author.

You can assert the validity of the binary distribution by comparing against the below cksums.

CheckSum	File
3660542740 550077	aws-athena-federation-sdk-2023.8.3.jar
1065933027 27824441	aws-athena-federation-sdk-2023.8.3-withdep.jar

What's Changed

• BlockUtils: Fix epoch day calculation
• Add LambdaRoleARN parameter to sqlserver and mysql connectors

Full Changelog: https://github.com/awslabs/aws-athena-query-federation/compare/v2023.8.2..v2023.8.3

Release v2023.8.2 of Athena Query Federation

This version includes improvements and bugfixes in some connectors. See here for changes since the last release.

Binary distribution of the SDK can be found here. For pre-built versions of the connector and UDF suite please:

1. Navigate to Serverless Application Repository and search for "athena-federation". Also check the checkbox labeled "Show apps that create custom IAM roles or resource policies".

2. Look for entries published by the "Amazon Athena Federation" author.

You can assert the validity of the binary distribution by comparing against the below cksums.

CheckSum	File
476740909 550142	aws-athena-federation-sdk-2023.8.2.jar
566381283 27824506	aws-athena-federation-sdk-2023.8.2-withdep.jar

What's Changed

• bump_versions/common.py: use gh cli instead of curl (#1071)
• added support for scram without SSL encryption (#1069)

Full Changelog: https://github.com/awslabs/aws-athena-query-federation/compare/v2023.8.1..v2023.8.2

Release v2023.8.1 of Athena Query Federation

This version includes improvements and bugfixes in some connectors. See here for changes since the last release.

Binary distribution of the SDK can be found here. For pre-built versions of the connector and UDF suite please:

1. Navigate to Serverless Application Repository and search for "athena-federation". Also check the checkbox labeled "Show apps that create custom IAM roles or resource policies".

2. Look for entries published by the "Amazon Athena Federation" author.

You can assert the validity of the binary distribution by comparing against the below cksums.

CheckSum	File
305376279 550140	aws-athena-federation-sdk-2023.8.1.jar
3750817029 27824504	aws-athena-federation-sdk-2023.8.1-withdep.jar

What's Changed

• build(deps): bump jsii-runtime from 1.74.0 to 1.75.0 (#1054)
• build(deps): bump google-cloud-resourcemanager from 1.12.0 to 1.13.0 (#1063)
• build(deps-dev): bump equalsverifier from 3.13.1 to 3.13.2 (#1062)
• build(deps): bump postgresql from 42.5.3 to 42.5.4 (#1061)
• build(deps): bump protobuf-java from 3.21.12 to 3.22.0 (#1060)
• build(deps): bump netty.version from 4.1.88.Final to 4.1.89.Final (#1058)
• build(deps): bump maven-javadoc-plugin from 3.4.1 to 3.5.0 (#1057)
• build(deps): bump surefire.failsafe.version from 3.0.0-M8 to 3.0.0-M9 (#1056)
• build(deps): bump lettuce-core from 6.2.2.RELEASE to 6.2.3.RELEASE (#1055)
• build(deps): bump aws-cdk.version from 1.192.0 to 1.193.0 (#1053)
• build(deps): bump aws-sdk.version from 1.12.405 to 1.12.410 (#1052)
• athena-msk: Update source type (#1050)
• Add Kafka connector (#1049)
• Run the build workflow only for push (#1046)
• build(deps-dev): bump equalsverifier from 3.13 to 3.13.1 (#1045)
• build(deps): bump ojdbc8 from 21.8.0.0 to 21.9.0.0 (#1044)
• build(deps): bump google-cloud-storage from 2.17.2 to 2.18.0 (#1042)
• build(deps): bump mongo-java-driver from 3.12.11 to 3.12.12 (#1041)
• build(deps): bump kafka-clients from 3.3.2 to 3.4.0 (#1040)
• build(deps): bump netty.version from 4.1.87.Final to 4.1.88.Final (#1039)
• build(deps): bump aws-cdk.version from 1.191.0 to 1.192.0 (#1037)
• build(deps): bump aws-sdk.version from 1.12.400 to 1.12.405 (#1036)
• improve description of the parameter in yaml file when creating connector (#1034)

Full Changelog: https://github.com/awslabs/aws-athena-query-federation/compare/v2023.6.1..v2023.8.1

Release v2023.6.1 of Athena Query Federation

This version includes improvements and bugfixes in some connectors. See here for changes since the last release.

Binary distribution of the SDK can be found here. For pre-built versions of the connector and UDF suite please:

1. Navigate to Serverless Application Repository and search for "athena-federation". Also check the checkbox labeled "Show apps that create custom IAM roles or resource policies".

2. Look for entries published by the "Amazon Athena Federation" author.

You can assert the validity of the binary distribution by comparing against the below cksums.

CheckSum	File
4208050903 550139	aws-athena-federation-sdk-2023.6.1.jar
373729361 27775149	aws-athena-federation-sdk-2023.6.1-withdep.jar

What's Changed

• athena-gcs: eliminate reliance on external environment variables (#1019)
• athena-gcs: fix bug with trimming leading / (#1032)
• build(deps): bump aws-msk-iam-auth from 1.1.5 to 1.1.6 (#1031)
• build(deps): bump snowflake-jdbc from 3.13.26 to 3.13.27 (#1030)
• build(deps-dev): bump equalsverifier from 3.12.4 to 3.13 (#1029)
• build(deps): bump zookeeper from 3.8.0 to 3.8.1 (#1028)
• build(deps-dev): bump DynamoDBLocal from 1.20.0 to 1.21.0 (#1027)
• build(deps): bump postgresql from 42.5.1 to 42.5.3 (#1025)
• build(deps): bump google-cloud-resourcemanager from 1.11.0 to 1.12.0 (#1024)
• build(deps): bump hbase.version from 2.5.2-hadoop3 to 2.5.3-hadoop3 (#1023)
• build(deps): bump aws-cdk.version from 1.190.0 to 1.191.0 (#1020)
• build(deps): bump aws-sdk.version from 1.12.395 to 1.12.400 (#1022)
• build(deps): bump grpc-google-cloud-bigquerystorage-v1 (#1021)

Full Changelog: https://github.com/awslabs/aws-athena-query-federation/compare/v2023.5.4..v2023.6.1

Release v2023.5.4 of Athena Query Federation

This version includes improvements and bugfixes in some connectors. See here for changes since the last release.

Binary distribution of the SDK can be found here. For pre-built versions of the connector and UDF suite please:

1. Navigate to Serverless Application Repository and search for "athena-federation". Also check the checkbox labeled "Show apps that create custom IAM roles or resource policies".

2. Look for entries published by the "Amazon Athena Federation" author.

You can assert the validity of the binary distribution by comparing against the below cksums.

CheckSum	File
4071274164 550139	aws-athena-federation-sdk-2023.5.4.jar
1997204690 27775018	aws-athena-federation-sdk-2023.5.4-withdep.jar

What's Changed

• Fix Timestream timestamp field value.

Full Changelog: https://github.com/awslabs/aws-athena-query-federation/compare/v2023.5.3..v2023.5.4

Release v2023.5.3 of Athena Query Federation

This version includes improvements and bugfixes in some connectors. See here for changes since the last release.

Binary distribution of the SDK can be found here. For pre-built versions of the connector and UDF suite please:

1. Navigate to Serverless Application Repository and search for "athena-federation". Also check the checkbox labeled "Show apps that create custom IAM roles or resource policies".

2. Look for entries published by the "Amazon Athena Federation" author.

You can assert the validity of the binary distribution by comparing against the below cksums.

CheckSum	File
3191159392 550139	aws-athena-federation-sdk-2023.5.3.jar
3350001080 27775018	aws-athena-federation-sdk-2023.5.3-withdep.jar

What's Changed

• Merge pull request #1014 from awslabs/fix_gcs_jar
• athena-gcs: Use maven assembly instead of shade

Full Changelog: https://github.com/awslabs/aws-athena-query-federation/compare/v2023.5.2..v2023.5.3

Release v2023.5.2 of Athena Query Federation

This version includes improvements and bugfixes in some connectors. See here for changes since the last release.

Binary distribution of the SDK can be found here. For pre-built versions of the connector and UDF suite please:

1. Navigate to Serverless Application Repository and search for "athena-federation". Also check the checkbox labeled "Show apps that create custom IAM roles or resource policies".

2. Look for entries published by the "Amazon Athena Federation" author.

You can assert the validity of the binary distribution by comparing against the below cksums.

CheckSum	File
1096505305 550142	aws-athena-federation-sdk-2023.5.2.jar
1055271164 27775021	aws-athena-federation-sdk-2023.5.2-withdep.jar

What's Changed

• athena-gcs: some more cleanup (#994)

Full Changelog: https://github.com/awslabs/aws-athena-query-federation/compare/v2023.5.1..v2023.5.2

Release v2023.5.1 of Athena Query Federation

This version includes improvements and bugfixes in some connectors. See here for changes since the last release.

Binary distribution of the SDK can be found here. For pre-built versions of the connector and UDF suite please:

1. Navigate to Serverless Application Repository and search for "athena-federation". Also check the checkbox labeled "Show apps that create custom IAM roles or resource policies".

2. Look for entries published by the "Amazon Athena Federation" author.

You can assert the validity of the binary distribution by comparing against the below cksums.

CheckSum	File
1302257884 550139	aws-athena-federation-sdk-2023.5.1.jar
1577809053 27775018	aws-athena-federation-sdk-2023.5.1-withdep.jar

What's Changed

• build(deps): bump aws-cdk.version from 1.189.0 to 1.190.0 (#998)
• build(deps): bump libraries-bom from 25.2.0 to 26.5.0 (#1009)
• build(deps): bump google-cloud-resourcemanager from 1.10.0 to 1.11.0 (#1008)
• build(deps): bump gremlinDriverVersion from 3.6.1 to 3.6.2 (#1006)
• build(deps): bump grpc-google-cloud-bigquerystorage-v1 (#1005)
• athena-dynamodb: Added logic to handle Null value within List or Set (#996)
• build(deps): bump msal4j from 1.13.3 to 1.13.4 (#1003)
• build(deps): bump google-cloud-bigquery from 2.20.2 to 2.21.0 (#1002)
• build(deps-dev): bump equalsverifier from 3.12.3 to 3.12.4 (#1001)
• build(deps): bump fasterxml.jackson.version from 2.14.1 to 2.14.2 (#1000)
• build(deps): bump aws-sdk.version from 1.12.389 to 1.12.395 (#999)
• build(deps): bump jsii-runtime from 1.73.0 to 1.74.0 (#997)
• Add option to select custom lambda role when deploying the PostgreSQL connector (#995)
• athena-google-bigquery: make subnets and security groups optional (#993)

Full Changelog: https://github.com/awslabs/aws-athena-query-federation/compare/v2023.4.1..v2023.5.1

Release v2023.4.1 of Athena Query Federation

This version includes improvements and bugfixes in some connectors. See here for changes since the last release.

Binary distribution of the SDK can be found here. For pre-built versions of the connector and UDF suite please:

1. Navigate to Serverless Application Repository and search for "athena-federation". Also check the checkbox labeled "Show apps that create custom IAM roles or resource policies".

2. Look for entries published by the "Amazon Athena Federation" author.

You can assert the validity of the binary distribution by comparing against the below cksums.

CheckSum	File
3324838097 550139	aws-athena-federation-sdk-2023.4.1.jar
1347853078 27739939	aws-athena-federation-sdk-2023.4.1-withdep.jar

What's Changed

• Added support for BigInt in DocDB connector (#991)
• Athena GCS Connector (#929)
• build(deps): bump grpc-google-cloud-bigquerystorage-v1 (#990)
• build(deps): bump aws-sdk.version from 1.12.387 to 1.12.389 (#989)
• build(deps): bump google-cloud-resourcemanager from 1.9.0 to 1.10.0 (#983)
• build(deps): bump google-cloud-bigquery from 2.20.1 to 2.20.2 (#978)
• build(deps): bump grpc-google-cloud-bigquerystorage-v1 (#977)

Full Changelog: https://github.com/awslabs/aws-athena-query-federation/compare/v2023.3.1..v2023.4.1