Skip to content

Streamis 0.3.0 Release
Compare
Choose a tag to compare
@Alexkun Alexkun released this 17 Aug 06:43
· 2 commits to main since this release
0.3.0
100209d

Streamis 0.3.0 includes all of Project Streamis-0.3.0.

Streamis 0.3.0 has some important architecture updates and optimizations, including Separate Flink application support and Flink management engine connectors, and adds checks for snapshots and applications with the same name on yarn before starting jobs. Streamis 0.3.0 is compatible with multiple versions of Linkis (>= 1.1.2), but some related features require 1.4.0 or later.
Streamis 0.3.0 mainly adds the following features:

  • Added separate management mode for Flink tasks. (requires Linkis 1.4.0)
  • Add Flink management ec support. (requires Linkis 1.4.0)
  • Add startup check for job task startup, check the snapshot address and the application with the same name on yarn. (requires Linkis 1.4.0)
  • Support for DSS proxy users. (requires DSS 1.1.2)
  • Collect and aggregate Yarn flow application log callbacks, and write them locally on the streamis side. The collection terminal supports filtering callback logs according to different levels

Abbreviations:

  • DSS: DataSphereStudio

New Feature

  • Streamis-74 [Streamis-jobmanager] Flink tasks add separate management mode
  • Streamis-75 [Streamis-jobmanager] Add flink management ec support
  • Streamis-77 [Streamis-jobmanager] Streamis job task startup adds startup check
  • Streamis-73 [Streamis-jobmanager] When starting a job, it will automatically check the application with the same name on yarn
  • Streamis-76 [Streamis-jobmanager] Streamis application parameter configuration import
  • Streamis-95 [Streamis-jobmanager] collects and aggregates streaming application logs, and writes them locally on the streamis side
  • Streamis-84 [Streamis-appconn] Streamis data interface permission adjustment
  • Streamis-81 [Streamis-appconn] Cooperate with DSS to switch proxy users
  • Streamis-68 [Streamis-jobmanager] jobs support label filtering

Enhancement

  • Streamis-88 [Streamis-Web] Rendering and interface adjustment of task configuration interface
  • Streamis-89 [Streamis-jobmanager] Refactor the automatic restart of streaming applications and optimize the idempotent problem
  • Streamis-87 [Streamis-jobmanager] Streamis task abort process adjustment, optimized job stop function, added to scheduling
  • Streamis-80 [Streamis-jobmanager] Added keyword filtering strategy on the collection side
  • Streamis-78 [Streamis-jobmanager] Application initialization supports application online import and version management
  • Streamis-71 [Streamis-jobmanager] Check the configuration of persion on task failure before the task starts
  • Streamis-79 [Streamis-jobmanager] supports multiple local drivers to store streaming application logs
  • Streamis-72 [Streamis-projectmanager] Upload project resource files to add md5

Bugs Fix

  • Streamis-96 [Streamis-Web] Fix the problem that the next page cannot be displayed on the historical task log page, and display the flink ec paged log on the log interface
  • Streamis-97 [Streamis] Code scanning bugs and smells fixed

Credits

The release of Streamis 0.3.0 is inseparable from the contributors of the Streamis community, thanks to all community contributors.

Compiled Version

Streamis0.3.0 installation package: click me to download

Streamis0.3.0 appconn plugin package: click me to download

DSS1.1.2&Linkis1.4.0 one-click installation package: click me to download

Assets 2
Loading