Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature][Zeta engine] Added the metrics information of table statistics in multi-table mode #7088

Closed
wants to merge 72 commits into from
Closed

[Feature][Zeta engine] Added the metrics information of table statistics in multi-table mode #7088

wants to merge 72 commits into from

Commits on Jun 26, 2024

  1. [Feature][Zeta engine] Added the metrics information of table statist… 

    …ics in multi-table mode apache#6959
    @hawk9821
    hawk9821 committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    a15db44 View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2024

  1. [Feature][Zeta engine] Added the metrics information of table statist… 

    …ics in multi-table mode apache#6959
    @hawk9821
    hawk9821 committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    993bb8d View commit details
    Browse the repository at this point in the history

Commits on Jun 28, 2024

  1. [Feature][Zeta engine] Added the metrics information of table statist… 

    …ics in multi-table mode apache#6959
    @hawk9821
    hawk9821 committed Jun 28, 2024
    Configuration menu
    Copy the full SHA
    1b7ad46 View commit details
    Browse the repository at this point in the history

  2. [Feature][Zeta engine] Added the metrics information of table statist… 

    …ics in multi-table mode apache#6959
    @hawk9821
    hawk9821 committed Jun 28, 2024
    Configuration menu
    Copy the full SHA
    891e2f5 View commit details
    Browse the repository at this point in the history

Commits on Jul 1, 2024

  1. [Feature][Zeta engine] Added the metrics information of table statist… 

    …ics in multi-table mode apache#6959
    @hawk9821
    hawk9821 committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    0cdb1f4 View commit details
    Browse the repository at this point in the history

  2. [Feature][Zeta engine] Added the metrics information of table statist… 

    …ics in multi-table mode apache#6959
    @hawk9821
    hawk9821 committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    182bc48 View commit details
    Browse the repository at this point in the history

Commits on Jul 9, 2024

  1. [Feature][Zeta engine] Added the metrics information of table statist… 

    …ics in multi-table mode apache#6959
    @hawk9821
    hawk9821 committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    4e5624c View commit details
    Browse the repository at this point in the history

Commits on Jul 10, 2024

  1. [Feature][Zeta engine] Added the metrics information of table statist… 

    …ics in multi-table mode apache#6959
    @hawk9821
    hawk9821 committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    3053810 View commit details
    Browse the repository at this point in the history

  2. [Feature][Zeta engine] Added the metrics information of table statist… 

    …ics in multi-table mode apache#6959
    @hawk9821
    hawk9821 committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    519433c View commit details
    Browse the repository at this point in the history

Commits on Jul 11, 2024

  1. [Feature][Zeta engine] Added the metrics information of table statist… 

    …ics in multi-table mode apache#6959
    @hawk9821
    hawk9821 committed Jul 11, 2024
    Configuration menu
    Copy the full SHA
    ab976a1 View commit details
    Browse the repository at this point in the history

  2. [Feature][Zeta engine] Added the metrics information of table statist… 

    …ics in multi-table mode apache#6959
    @hawk9821
    hawk9821 committed Jul 11, 2024
    Configuration menu
    Copy the full SHA
    a8a806c View commit details
    Browse the repository at this point in the history

Commits on Jul 13, 2024

  1. [Feature][Zeta] Add tag to node used to filter worker when submit job (… 

    …apache#7045)
    @liunaijie @hawk9821
    liunaijie authored and hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    cac45fe View commit details
    Browse the repository at this point in the history

  2. [Improve][Zeta] Fix JobMaster reset app classloader twice (apache#7063)

    @Hisoka-X @hawk9821
    Hisoka-X authored and hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    36d4fb6 View commit details
    Browse the repository at this point in the history

  3. [Fix][Connector-V2] Fix starrocks Content-Length header already prese… 

    …nt error (apache#7034)
    @Hisoka-X @hawk9821
    Hisoka-X authored and hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    4888b75 View commit details
    Browse the repository at this point in the history

  4. [Improve][Doc] Fix snowflake jdbc url with emoji (apache#7061)

    @Hisoka-X @hawk9821
    Hisoka-X authored and hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    f3efe20 View commit details
    Browse the repository at this point in the history

  5. [Hotfix][Hive Connector] Fix Hive hdfs-site.xml and hive-site.xml not… 

    … be load error (apache#7069)
    @EricJoy2048 @hawk9821
    EricJoy2048 authored and hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    805c36e View commit details
    Browse the repository at this point in the history

  6. [Feature] [Github CI] connector-kafka-e2e , connector-rocketmq-e2e mo… 

    …dule runs repeatedly apache#7090 (apache#7091)
    @hawk9821
    hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    de96c28 View commit details
    Browse the repository at this point in the history

  7. [Doc] correct the document (apache#7099)

    @liunaijie @hawk9821
    liunaijie authored and hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    a9f2318 View commit details
    Browse the repository at this point in the history

  8. typo (apache#7100)

    @liunaijie @hawk9821
    liunaijie authored and hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    0ecc5d9 View commit details
    Browse the repository at this point in the history

  9. [Feature][connector][kafka] Support read Maxwell format message from … 

    …kafka apache#4415 (apache#4428)
    @zhilinli123 @hawk9821
    zhilinli123 authored and hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    79243a2 View commit details
    Browse the repository at this point in the history

  10. [Improve][Redis] Redis reader use scan cammnd instead of keys, single… 

    … mode reader/writer support batch (apache#7087)
    @FuYouJ @hawk9821
    FuYouJ authored and hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    db209c2 View commit details
    Browse the repository at this point in the history

  11. [Improve][E2E][Doris] Add no schema test case for connector-doris-e2e (… 

    …apache#7076)
    @bingquanzhao @hawk9821
    bingquanzhao authored and hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    d8644bd View commit details
    Browse the repository at this point in the history

  12. [Improve] Fix plugin_config (apache#7104)

    @hailin0 @hawk9821
    hailin0 authored and hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    9eb7657 View commit details
    Browse the repository at this point in the history

  13. [CI][Test] Fix engine-k8s-it failed (apache#7101) 

    * update

* update
    @Hisoka-X @hawk9821
    Hisoka-X authored and hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    79e4996 View commit details
    Browse the repository at this point in the history

  14. [Improve][Connector-V2] Support schema evolution for mysql-cdc and my… 

    …sql-jdbc (apache#6929)
    @dailai @hawk9821
    dailai authored and hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    6b213dc View commit details
    Browse the repository at this point in the history

  15. [Chore] remove useless codes (apache#7110)

    @TyrantLucifer @hawk9821
    TyrantLucifer authored and hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    b370f1b View commit details
    Browse the repository at this point in the history

  16. [Docs] update rest-api doc (apache#7111)

    @liunaijie @hawk9821
    liunaijie authored and hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    5e72255 View commit details
    Browse the repository at this point in the history

  17. [Hotfix][connector-v2-rabbit] fix rabbit checkpoint exception in Flin… 

    …k mode (apache#7108)
    @zhangshenghang @hawk9821
    zhangshenghang authored and hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    2c6d81e View commit details
    Browse the repository at this point in the history

  18. [Improve][Doc] Improve DingTalk doc (apache#7075)

    @MRYOG @hawk9821
    MRYOG authored and hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    d18b58b View commit details
    Browse the repository at this point in the history

  19. [Docs][connector-sink] add Docs connector v2 sink (apache#7097)

    @zhangshenghang @hawk9821
    zhangshenghang authored and hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    9b05fe2 View commit details
    Browse the repository at this point in the history

  20. [feature][connector-v2-hbase-sink] Support Connector v2 HBase sink TT… 

    …L data writing (apache#7116)
    @zhangshenghang @hawk9821
    zhangshenghang authored and hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    e17afac View commit details
    Browse the repository at this point in the history

  21. [Fix][Connector-V2][CDC] SeaTunnelRowDebeziumDeserializationConverter… 

    …s NPE (apache#7119)
    @Asura7969 @hawk9821
    Asura7969 authored and hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    9996b3f View commit details
    Browse the repository at this point in the history

  22. [Feature][Zeta] Add Master and Worker split mode deployment (apache#6947 

    )
    @EricJoy2048 @hawk9821
    EricJoy2048 authored and hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    e62e48b View commit details
    Browse the repository at this point in the history

  23. [Improve][Document] Fix Postgre to PostgreSQL in Postgre-CDC.md file (a… 

    …pache#7112)
    @Vonng @hawk9821
    Vonng authored and hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    ab5eeff View commit details
    Browse the repository at this point in the history

  24. [feature][connector-file-local] add save mode function for localfile (a… 

    …pache#7080)
    @chl-wxp @hawk9821
    chl-wxp authored and hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    b8995e6 View commit details
    Browse the repository at this point in the history

  25. [Feature][Connector-V2][Clickhouse] Add clickhouse.config to the sour… 

    …ce connector (apache#7143)

* The source connector of Clickhouse support a custom clickhouse config

* UPDATE doc

* fmt

---------

Co-authored-by: Dongyeon <[email protected]>
    @loustler @hawk9821
    2 people authored and hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    100d302 View commit details
    Browse the repository at this point in the history

  26. [Improve] Change catalog table log to debug level (apache#7136)

    @Hisoka-X @hawk9821
    Hisoka-X authored and hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    62dc1a2 View commit details
    Browse the repository at this point in the history

  27. [Fix][Zeta] Fix env jars not working on zeta (apache#7035)

    @Hisoka-X @hawk9821
    Hisoka-X authored and hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    d7edcb7 View commit details
    Browse the repository at this point in the history

  28. [Fix][Flink-starter]Hotfix flink checkpoint default value (apache#7040)

    @zhangshenghang @hawk9821
    zhangshenghang authored and hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    5210cc7 View commit details
    Browse the repository at this point in the history

  29. [Feature][Connector-V2] Support jdbc hana catalog and type convertor (a… 

    …pache#6950)
    @Hisoka-X @hawk9821
    Hisoka-X authored and hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    51efc56 View commit details
    Browse the repository at this point in the history

  30. [Feature][Connector-V2] [Hudi]Add hudi sink connector (apache#4405)

    @liugddx @hawk9821
    liugddx authored and hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    7d6e390 View commit details
    Browse the repository at this point in the history

  31. [Fix][Connector-V2][Elasticsearch]Fix sink configuration for DROP_DATA ( 

    apache#7124)
    @Wudadada @hawk9821
    Wudadada authored and hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    e53e1aa View commit details
    Browse the repository at this point in the history

  32. [Fix][Connector-V2] Fix kafka batch mode can not read all message (ap… 

    …ache#7135)
    @Hisoka-X @hawk9821
    Hisoka-X authored and hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    e909746 View commit details
    Browse the repository at this point in the history

  33. [Feature][Core] Add a test case for dynamic custom parameters (apache… 

    …#7128)
    @liugddx @hawk9821
    liugddx authored and hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    1e4ed74 View commit details
    Browse the repository at this point in the history

  34. [Improve][hbase] The specified column is written to the specified col… 

    …umn family (apache#5234)
    @zhilinli123 @hawk9821
    zhilinli123 authored and hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    45a3261 View commit details
    Browse the repository at this point in the history

  35. [Hotfix][Zeta] Fix that batch tasks cannot be stopped after retrying (a… 

    …pache#7083)
    @hailin0 @hawk9821
    hailin0 authored and hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    b19971c View commit details
    Browse the repository at this point in the history

  36. [Improve][connector-v2-jdbc-mysql] Add support for MySQL 8.4 (apache#… 

    …7151)

* [Improve][connector-v2-jdbc-mysql] Add support for MySQL 8.4

* [Improve][connector-v2-jdbc-mysql] Add support for MySQL 8.4
    @wuchunfu @hawk9821
    wuchunfu authored and hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    1f18032 View commit details
    Browse the repository at this point in the history

  37. [Improve][Zeta] Add retry when request slot on resource manager (apac… 

    …he#7049)
    @Hisoka-X @hawk9821
    Hisoka-X authored and hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    cd0e4d3 View commit details
    Browse the repository at this point in the history

  38. 1 (apache#7154)

    @liugddx @hawk9821
    liugddx authored and hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    e1f1b89 View commit details
    Browse the repository at this point in the history

  39. [Docs] Update quick start v2 related docs info (apache#7161)

    @tcodehuber @hawk9821
    tcodehuber authored and hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    37e2821 View commit details
    Browse the repository at this point in the history

  40. [Feature][RestAPI] overview support tag filter (apache#7173)

    @liunaijie @hawk9821
    liunaijie authored and hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    49a2579 View commit details
    Browse the repository at this point in the history

  41. [Improve][CI] Add auto label action (apache#7174)

    @Hisoka-X @hawk9821
    Hisoka-X authored and hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    1fe9990 View commit details
    Browse the repository at this point in the history

  42. [Feature][Connector-V2][Milvus] Support Milvus source & sink (apache#… 

    …7158)
    @Thomas-HuWei @hawk9821
    Thomas-HuWei authored and hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    2254e2d View commit details
    Browse the repository at this point in the history

  43. [Improve][CI] Add milvus to label (apache#7186)

    @Hisoka-X @hawk9821
    Hisoka-X authored and hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    65bd3e3 View commit details
    Browse the repository at this point in the history

  44. [Docs] Update concept related docs info (apache#7184)

    @tcodehuber @hawk9821
    tcodehuber authored and hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    710cd5a View commit details
    Browse the repository at this point in the history

  45. [Docs]translate clickhousefile,phoenix,rabbitmq,starrocks sink doc in… 

    …to chinese (apache#7015)
    @latch890727 @hawk9821
    latch890727 authored and hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    03dc7ed View commit details
    Browse the repository at this point in the history

  46. [Feature][Zeta engine] Added the metrics information of table statist… 

    …ics in multi-table mode apache#6959
    @hawk9821
    hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    4085589 View commit details
    Browse the repository at this point in the history

  47. [Feature][Zeta engine] Added the metrics information of table statist… 

    …ics in multi-table mode apache#6959
    @hawk9821
    hawk9821 committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    9b57d41 View commit details
    Browse the repository at this point in the history

Commits on Jul 15, 2024

  1. [Docs] Update transform about and faq related docs info (apache#7187)

    @tcodehuber @hawk9821
    tcodehuber authored and hawk9821 committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    7046e7a View commit details
    Browse the repository at this point in the history

  2. [Docs] Update contribution and readme related docs info (apache#7188)

    @tcodehuber @hawk9821
    tcodehuber authored and hawk9821 committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    efcfbc8 View commit details
    Browse the repository at this point in the history

  3. Bump org.xerial.snappy:snappy-java (apache#7144) 

    Bumps [org.xerial.snappy:snappy-java](https://github.com/xerial/snappy-java) from 1.1.8.3 to 1.1.10.4.
- [Release notes](https://github.com/xerial/snappy-java/releases)
- [Commits](xerial/snappy-java@1.1.8.3...v1.1.10.4)

---
updated-dependencies:
- dependency-name: org.xerial.snappy:snappy-java
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    @dependabot @hawk9821
    dependabot[bot] authored and hawk9821 committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    4f5928c View commit details
    Browse the repository at this point in the history

  4. Fix iceberg e2e image tag (apache#7189)

    @hailin0 @hawk9821
    hailin0 authored and hawk9821 committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    637f9a2 View commit details
    Browse the repository at this point in the history

  5. [Improve][Jdbc] Remove user info in catalog-table options (apache#7178)

    @hailin0 @hawk9821
    hailin0 authored and hawk9821 committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    1eaf04d View commit details
    Browse the repository at this point in the history

  6. [Improve][Hive] Close resources when exception occurs (apache#7205)

    @hailin0 @hawk9821
    hailin0 authored and hawk9821 committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    c840f6b View commit details
    Browse the repository at this point in the history

  7. [Improve] Improve error message when can not parse datetime value (ap… 

    …ache#7181)

* [Improve] Improve error message when can not parse datetime value

* update
    @Hisoka-X @hawk9821
    Hisoka-X authored and hawk9821 committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    ce79ac5 View commit details
    Browse the repository at this point in the history

  8. Update backend.yml (apache#7122)

    @Hisoka-X @hawk9821
    Hisoka-X authored and hawk9821 committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    0cfb2e6 View commit details
    Browse the repository at this point in the history

  9. [Feature][Zeta engine] Added the metrics information of table statist… 

    …ics in multi-table mode apache#6959
    @hawk9821
    hawk9821 committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    556d772 View commit details
    Browse the repository at this point in the history

  10. [Feature][Zeta engine] Added the metrics information of table statist… 

    …ics in multi-table mode apache#6959
    @hawk9821
    hawk9821 committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    a3f2266 View commit details
    Browse the repository at this point in the history

  11. [Feature][RestAPI] overview support tag filter (apache#7173)

    @liunaijie @hawk9821
    liunaijie authored and hawk9821 committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    02a81da View commit details
    Browse the repository at this point in the history

  12. [Feature][Zeta engine] Added the metrics information of table statist… 

    …ics in multi-table mode apache#6959
    @hawk9821
    hawk9821 committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    242cc36 View commit details
    Browse the repository at this point in the history

  13. [Feature][Zeta engine] Added the metrics information of table statist… 

    …ics in multi-table mode apache#6959
    @hawk9821
    hawk9821 committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    f971e89 View commit details
    Browse the repository at this point in the history

Commits on Jul 16, 2024

  1. [Feature][Zeta engine] Added the metrics information of table statist… 

    …ics in multi-table mode apache#6959
    @hawk9821
    hawk9821 committed Jul 16, 2024
    Configuration menu
    Copy the full SHA
    573488f View commit details
    Browse the repository at this point in the history