Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat(backend): Add Parallelism Limit to ParallelFor tasks. Fixes #8718 #10798

Open
wants to merge 6 commits into
base: master
Choose a base branch
from
Open

feat(backend): Add Parallelism Limit to ParallelFor tasks. Fixes #8718 #10798

wants to merge 6 commits into from

Commits on Sep 6, 2024

  1. feat(backend): Add Parallelism Limit to ParallelFor tasks 

    Signed-off-by: Giulio Frasca <[email protected]>
    @gmfrasca
    gmfrasca committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    490442f View commit details
    Browse the repository at this point in the history

  2. feat(backend): Add intermediate Template for iterator Tasks in ArgoCo… 

    …mpiler

Signed-off-by: Giulio Frasca <[email protected]>
    @gmfrasca
    gmfrasca committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    814e879 View commit details
    Browse the repository at this point in the history

  3. test: Add argoCompiler test case to validate individual parallel-limi… 

    …ted tasks

Signed-off-by: Giulio Frasca <[email protected]>
    @gmfrasca
    gmfrasca committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    2423b02 View commit details
    Browse the repository at this point in the history

  4. test: Update tests for ParallelFor loop update 

    Signed-off-by: Giulio Frasca <[email protected]>
    @gmfrasca
    gmfrasca committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    455593b View commit details
    Browse the repository at this point in the history

  5. fix(backend): Fix broken dependantTasks in ParallelFor 

    Signed-off-by: Giulio Frasca <[email protected]>
    @gmfrasca
    gmfrasca committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    86ec1e3 View commit details
    Browse the repository at this point in the history

  6. fix(backend): pass correct ParentDagID to iterator DAG 

    - Passthrough ParentDagID rather than DriverExecutionID to iterator such
  that iteration item correctly detects dependentTasks.
- Remove depends from iterator DAG as it is already handled by
  root-level task
- Update Iterator template names/nomenclature for clarity
- Update tests accordingly

Signed-off-by: Giulio Frasca <[email protected]>
    @gmfrasca
    gmfrasca committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    fa8f144 View commit details
    Browse the repository at this point in the history