Upgrade AWS Java SDK to v2

[achals]

Feature request

Which Delta project/connector is this regarding?

• Spark
• Standalone
• Flink

Overview

The AWS Java SDK v1 has entered maintenance mode July 31 2024 (https://aws.amazon.com/blogs/developer/announcing-end-of-support-for-aws-sdk-for-java-v1-x-on-december-31-2025/)

AWS Java SDK v2 has been around for a while now, and is generally better structured than the v1 sdk. It would be good to upgrade this dependency in the delta libraries to the v2 version.

Motivation

This upgrade is important for security and performance. All customers should benefit from it.

Further details

Willingness to contribute

The Delta Lake Community encourages new feature contributions. Would you or another member of your organization be willing to contribute an implementation of this feature?

• Yes. I can contribute this feature independently.
• Yes. I would be willing to contribute this feature with guidance from the Delta Lake community.
• No. I cannot contribute this feature at this time.