3.2.1
Release date: December 21, 2023
New Features
Data Lake Analytics
- Supports reading Hive Catalog tables and file external tables in Avro, SequenceFile, and RCFile formats through Java Native Interface (JNI).
Materialized View
- Added a view
object_dependencies
to the databasesys
. It contains the lineage information of asynchronous materialized views. #35060 - Supports creating synchronous materialized views with the WHERE clause.
- Supports partition-level incremental refresh for asynchronous materialized views created upon Iceberg catalogs.
- [Preview] Supports creating asynchronous materialized views based on tables in a Paimon catalog with partition-level refresh.
Query and SQL functions
- Supports the prepared statement. It allows better performance for processing high-concurrency point lookup queries. It also prevents SQL injection effectively.
- Supports the following Bitmap functions: subdivide_bitmap, bitmap_from_binary, and bitmap_to_binary.
- Supports the Array function array_unique_agg.
Monitoring and alerts
- Added a new metric
max_tablet_rowset_num
for setting the maximum allowed number of rowsets. This metric helps detect possible compaction issues and thus reduces the occurrences of the error "too many versions". #36539
Parameter changes
- A new BE configuration item
enable_stream_load_verbose_log
is added. The default value isfalse
. With this parameter set totrue
, StarRocks can record the HTTP requests and responses for Stream Load jobs, making troubleshooting easier. #36113
Improvements
- Upgraded the default GC algorithm in JDK8 to G1. #37268
- A new value option
GROUP_CONCAT_LEGACY
is added to the session variable sql_mode to provide compatibility with the implementation logic of the group_concat function in versions earlier than v2.5. #36150 - The authentication information
aws.s3.access_key
andaws.s3.access_secret
for AWS S3 in Broker Load jobs are hidden in audit logs. #36571 - The
be_tablets
view in theinformation_schema
database provides a new fieldINDEX_DISK
, which records the disk usage (measured in bytes) of persistent indexes. #35615 - The result returned by the SHOW ROUTINE LOAD statement provides a new field
OtherMsg
, which shows information about the last failed task. #35806
Bug Fixes
Fixed the following issues:
- The BEs crash if users create persistent indexes in the event of data corruption.#30841
- The array_distinct function occasionally causes the BEs to crash. #36377
- After the DISTINCT window operator pushdown feature is enabled, errors are reported if SELECT DISTINCT operations are performed on the complex expressions of the columns computed by window functions. #36357
- Some S3-compatible object storage returns duplicate files, causing the BEs to crash. #36103