Update burst compute workflow to prepare it for node18 backend#1

Open

cgoina wants to merge 25 commits intomasterfrom node18

Commits on Nov 10, 2023

a first take to use node18 but invoke async does not work
Cristian Goina
committed

Commits on Nov 11, 2023

use map to distribute the work
Cristian Goina
committed
filter parameters to not pass batch results around
Cristian Goina
committed
eliminated filter params state
Cristian Goina
committed

Commits on Nov 13, 2023

added persist results state in order to persist directly from the state function
Cristian Goina
committed
removed states that did not seem to be used and from map went directly to combine or combineerror
Cristian Goina
committed
added states to handle partitioning of the batch jobs in order to satisfy the input size constraint of 256K
Cristian Goina
committed
specify payload for combine function to exclude batches
Cristian Goina
committed
put monitor back to check for timeout
Cristian Goina
committed

Commits on Nov 14, 2023

monitor needs all parameters that must propagate such as firstBatchId, lastBatchId, datasetStartIndex and datasetEndIndex
Cristian Goina
committed

Commits on Nov 16, 2023

use dump batches on s3 and use itemreader
Cristian Goina
committed

Commits on Nov 17, 2023

introduce an intermediate state to set completed flag
Cristian Goina
committed

Commits on Nov 28, 2023

specify runtime and architecture in the provider block - switch to arm64
Cristian Goina
committed

Commits on Feb 18, 2025

Merge branch 'master' into node18
Cristian Goina
committed
update some packages
Cristian Goina
committed

Commits on Feb 21, 2025

set up an org and updated the bundle plugin
Cristian Goina
committed

Commits on Feb 22, 2025

update runtime to node20x
Cristian Goina
committed

Commits on Feb 24, 2025

set toleratedPercentageFailure
Cristian Goina
committed

Commits on Feb 25, 2025

added cleanup step - to clean batch inputs
Cristian Goina
committed
changed logging message
Cristian Goina
committed
dotenv; additional state to check for errors
Cristian Goina
committed
renamed branching factor
Cristian Goina
committed

Commits on Feb 26, 2025

updated the to describe the new workflow
Cristian Goina
committed
update the default interface name
Cristian Goina
committed
updated diagram
krokicki
committed