Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upload benchmark results to S3 when the check step failed #998

Merged
merged 2 commits into from
Sep 6, 2024

Conversation

vladem
Copy link
Contributor

@vladem vladem commented Sep 5, 2024

Description of change

Recently we've started uploading benchmark results to S3 alongside GH pages, and do that even for runs triggered by pull requests.

When the PR's benchmarking workflow detects a 2x drop, it fails before reaching the step performing the s3 upload, which is unfortunate as these are the most interesting results to visualise.

Relevant issues: None

Does this change impact existing behavior?

No, just CI changes.

Does this change need a changelog entry in any of the crates?

No, just CI changes.


By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license and I agree to the terms of the Developer Certificate of Origin (DCO).

@vladem vladem temporarily deployed to PR integration tests September 5, 2024 09:50 — with GitHub Actions Inactive
@vladem vladem temporarily deployed to PR integration tests September 5, 2024 09:50 — with GitHub Actions Inactive
@vladem vladem temporarily deployed to PR integration tests September 5, 2024 09:50 — with GitHub Actions Inactive
@vladem vladem temporarily deployed to PR integration tests September 5, 2024 09:50 — with GitHub Actions Inactive
@vladem vladem temporarily deployed to PR integration tests September 5, 2024 09:50 — with GitHub Actions Inactive
@vladem vladem temporarily deployed to PR integration tests September 5, 2024 09:50 — with GitHub Actions Inactive
@vladem vladem temporarily deployed to PR integration tests September 5, 2024 09:50 — with GitHub Actions Inactive
@vladem vladem marked this pull request as ready for review September 5, 2024 09:50
@vladem vladem changed the title Save benchmark results to S3 when the check step failed Upload benchmark results to S3 when the check step failed Sep 5, 2024
dannycjones
dannycjones previously approved these changes Sep 5, 2024
@vladem vladem temporarily deployed to PR integration tests September 6, 2024 12:10 — with GitHub Actions Inactive
@vladem vladem temporarily deployed to PR integration tests September 6, 2024 12:10 — with GitHub Actions Inactive
@vladem vladem temporarily deployed to PR integration tests September 6, 2024 12:10 — with GitHub Actions Inactive
@vladem vladem temporarily deployed to PR integration tests September 6, 2024 12:10 — with GitHub Actions Inactive
@vladem vladem temporarily deployed to PR integration tests September 6, 2024 12:10 — with GitHub Actions Inactive
@vladem vladem temporarily deployed to PR integration tests September 6, 2024 12:10 — with GitHub Actions Inactive
@vladem vladem temporarily deployed to PR integration tests September 6, 2024 12:10 — with GitHub Actions Inactive
@vladem vladem added this pull request to the merge queue Sep 6, 2024
Merged via the queue into awslabs:main with commit 813f95d Sep 6, 2024
23 checks passed
@vladem vladem deleted the benchmark-to-s3-on-failure branch September 6, 2024 15:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants