Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[flink-runner] Improve Datastream for batch performances #32440

Open
wants to merge 21 commits into
base: master
Choose a base branch
from
Open

[flink-runner] Improve Datastream for batch performances #32440

wants to merge 21 commits into from
+1,433 −602

Commits on Sep 12, 2024

  1. [Flink] Set return type of bounded sources

    @jto
    jto committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    15a8fe5 View commit details
    Browse the repository at this point in the history

  2. [Flink] Use a lazy split enumerator for bounded sources 

    [Flink] fix lazy enumerator package
    @jto
    jto committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    aac640d View commit details
    Browse the repository at this point in the history

  3. [Flink] Default to maxParallelism = parallelism in batch

    @jto
    jto committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    4604548 View commit details
    Browse the repository at this point in the history

  4. [Flink] Avoid re-serializing trigger on every element

    @jto
    jto committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    3bed4b5 View commit details
    Browse the repository at this point in the history

  5. [Flink] Avoid re-evaluating options every time a new state is stored

    @jto
    jto committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    9b0614c View commit details
    Browse the repository at this point in the history

  6. [Flink] Only serialize states namespace keys if necessary

    @jto
    jto committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    03ffb76 View commit details
    Browse the repository at this point in the history

  7. [Flink] Make ToKeyedWorkItem part of the DoFnOperator

    @jto
    jto committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    bc94be1 View commit details
    Browse the repository at this point in the history

  8. [Flink] Remove ToBinaryKV

    @jto
    jto committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    675ef27 View commit details
    Browse the repository at this point in the history

  9. [Flink] Refactor CombinePerKeyTranslator

    @jto
    jto committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    97fd90b View commit details
    Browse the repository at this point in the history

  10. [Flink] Combine before Reduce (no side-input only) 

    [Flink] Implement partial reduce

[Flink] dead code cleanup

[Flink] spotless

[Flink] persistent PartialReduceBundleOperator operator state
    @jto
    jto committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    f4cfb70 View commit details
    Browse the repository at this point in the history

  11. [Flink] Combine before GBK

    @jto
    jto committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    aa97c47 View commit details
    Browse the repository at this point in the history

  12. [Flink] Combine before reduce (with side input)

    @jto
    jto committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    9b0d3cc View commit details
    Browse the repository at this point in the history

  13. [Flink] Force slot sharing group in batch mode

    @jto
    jto committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    bdb7c28 View commit details
    Browse the repository at this point in the history

  14. [Flink] Disable bundling in batch mode

    @jto
    jto committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    863c2c0 View commit details
    Browse the repository at this point in the history

  15. [Flink] Lower default max bundle size in batch mode

    @jto
    jto committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    a519bed View commit details
    Browse the repository at this point in the history

  16. [Flink] Code cleanup 

    * spotless
* checkstyle
* spotless
    @jto
    jto committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    0a0fb63 View commit details
    Browse the repository at this point in the history

  17. [Flink] fix WindowDoFnOperatorTest

    @jto
    jto committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    76a1672 View commit details
    Browse the repository at this point in the history

  18. [Flink] spotless 

    [Flink] spotless
    @jto
    jto committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    7979902 View commit details
    Browse the repository at this point in the history

  19. [Flink] fix broken tests

    @jto
    jto committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    3d44c2f View commit details
    Browse the repository at this point in the history

  20. [Flink] Remove 1.14 compat code

    @jto
    jto committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    03859e5 View commit details
    Browse the repository at this point in the history

Commits on Sep 13, 2024

  1. [Flink] Fix flaky test

    @jto
    jto committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    893c19f View commit details
    Browse the repository at this point in the history