Skip to content

Release 3.2.1

Compare
Choose a tag to compare
@Aryex Aryex released this 03 May 23:07
· 86 commits to main since this release
1c1b400

Overview

This release includes support for maps and a fix for the connector with Amazon EMR.

Map Support

Support for writing map into Vertica is added. However, it is very limited. You can only write maps to external tables and maps cannot be queried. Thus we cannot support writing maps to internal tables or reading maps from external and internal tables.

These limitations are from Vertica. As of Vertica 11.x map type is not supported and exists like it it is only for interoperability with external data.

It is suggested by Vertica to use Array[Row(key, value)] to represent maps inside Vertica.

Bug fixes

  • Fixed the issue where the connector failed to resolve Spark's version string when it contains non-numeric characters e.g. 3.2.1-amz-0
  • Fixed the issue with Spark connector failing to detect complex type columns when used against Vertica 10.