Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Question] Could we use deltaLake 3.2.0 with spark 3.2.1? #3632

Open
brewagebear opened this issue Sep 2, 2024 · 0 comments
Open

[Question] Could we use deltaLake 3.2.0 with spark 3.2.1? #3632

brewagebear opened this issue Sep 2, 2024 · 0 comments

Comments

@brewagebear
Copy link

brewagebear commented Sep 2, 2024

Currently, we are using version spark 3.2.1 with deltalake 2.0.1.

And when I checked the compatibility metric below,
https://docs.delta.io/latest/releases.html#compatibility-with-apache-spark

I saw that deltalake 3.2.0 is compatible with spark 3.5.x. However, the release note says just spark 3.5.x support, which is confusing.

The intention of my question is if the minimum compatible spark version of deltalake 3.2.0 is 3.5.x.

Also, I know that when you do deltalake version up, things like protocol version are important. Is there a guide document for upgrading the delta-lake version?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant