Skip to content

BoostKit OmniData Connector v1.0.0-c
Compare
Choose a tag to compare
@tushengxia tushengxia released this 15 Apr 03:37
· 4 commits to omnidata-spark-connector-cbg since this release
v1.0.0-c
c9cdff0
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.

Spark can use omnidata-spark-connector to visit omnidata feature for nearly data process.

Overview

In this version, the library supports filter, aggregation, and limit pushdown for Spark SQL. This library is developed based on Apache Spark SQL v3.0.0 and provides required JAR files.

Changes

This release includes some issues fixed, function enhancements and a zip:

-fix issues: null pointer with partitionValue and parsing failed with UDF "cast", agg columnOffset and bigint datatype.

-function enhancements: support detailed pushdown infos and some alert logs.

-boostkit-omnidata-spark-sql_2.12-3.0.0-1.0.0.zip: Released a zip of Spark Connector which contains JAR files of third-party dependency and this library packaged.

Assets 3
Loading