Skip to content

Commit

Permalink
Run replicate images in parallel
Browse files Browse the repository at this point in the history
  • Loading branch information
@jknipper
jknipper committed Sep 4, 2024
1 parent 7a33935 commit 975479c
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion ci/pipeline.yaml.erb
View file
Original file line number Diff line number Diff line change
Expand Up @@ -290,7 +290,7 @@ jobs:
args:
- -cx
- |
yq e '.imagesForVersion.*.*|.repository + ":" + .tag' kubernikus.git/charts/images.yaml | grep -v -E 'changeme|/ccloud/' | sed -E 's/\$REGION|global/eu-de-1/g' | sort -u | xargs -n1 keppel validate
yq e '.imagesForVersion.*.*|.repository + ":" + .tag' kubernikus.git/charts/images.yaml | grep -v -E 'changeme|/ccloud/' | sed -E 's/\$REGION|global/eu-de-1/g' | sort -u | xargs -n1 -P2 -I{} sh -c "keppel validate {}; sleep 2"

- name: master
serial: true
Expand Down

2 comments on commit 975479c

@majewsky
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

FYI, we explicitly disabled parallel replication in 1c09c5c because it was tripping up the Keppel rate limits. If you enable it again, please monitor closely that this does not cause 429 errors.

@jknipper
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, I noticed that and the sleep 2 did the trick. It's not that critical and we can adjust it if needed.

Please sign in to comment.