Skip to content

Evergreen clean up and migration to use AWS secrets manager #1728

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 14 commits into
base: main
Choose a base branch
from

Conversation

rozza
Copy link
Member

@rozza rozza commented Jun 5, 2025

Contains the following commits:

  1. Fix archiving logic
  2. Evergreen file reorganization - normalize naming and grouping of tasks. Add suffixes to tasks, and task_groups - allowing quicker navigation / searching for functions, tasks and task groups.
  3. Removed an unused task - found by evergreen validate ./.evergreen/.evg.yml
  4. Added a gradle-cache.sh so that build artifacts can be included and used via the create-archive-tar-file function.
  5. Removed --no-build-cache flags from scripts - it potentially hinders performance and wasn't required.
  6. Disabled failing oidc azure and gcp tasks - need more resources on the vms.
  7. Disabled serverless task - precursor to JAVA-5849 code cleanup work

@rozza rozza force-pushed the JAVA-5886 branch 5 times, most recently from 0883d01 to aa153b2 Compare June 9, 2025 08:41
@rozza
Copy link
Member Author

rozza commented Jun 9, 2025

Force pushed some cache changes 10th June.
New Full build: https://spruce.mongodb.com/version/6848169119c55b000786ae78

@rozza rozza requested a review from katcharov June 9, 2025 10:00
@rozza rozza marked this pull request as ready for review June 9, 2025 10:15
${PREPARE_SHELL}
rm -rf $DRIVERS_TOOLS || true

"add-aws-auth-variables-to-file":
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's difficult to compare some of the changes in this file. I don't think this is a problem, as long as we can confirm everything runs.

Have you confirmed that the task count is the same as before?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Confirmed the expected task count - previously was 728. Now its 729 - which accounts for the two extra k8s tests and the disabled serverless task.

params:
shell: "bash"
working_dir: "src"
script: |
${PREPARE_SHELL}
JAVA_VERSION=${JAVA_VERSION} AWS_CREDENTIAL_PROVIDER=${AWS_CREDENTIAL_PROVIDER} .evergreen/run-mongodb-aws-test.sh assume-role

"run aws auth test with aws EC2 credentials":
"run-aws-auth-test-with-aws-EC2 credentials":
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

missed a hyphen here

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done

JAVA_VERSION="${JAVA_VERSION}" \
AZUREKMS_KEY_VAULT_ENDPOINT=${testazurekms_keyvaultendpoint} AZUREKMS_KEY_NAME=${testazurekms_keyname} \
TESTS="testSlowOnly" .evergreen/run-tests.sh
"run-slow-tests":
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍 for the naming consistency

@rozza
Copy link
Member Author

rozza commented Jun 12, 2025

Changes since last review:

  • Fixed run-aws-auth-test-with-aws-EC2-credentials name (mising hypen).
  • updated evergreen machines as per recommendations in the [Guidelines around Evergreen distros
  • Reenabled gcp and azure tests
  • Split out the k8s tests - one varaint (gke) seems to continually fail due to resources.

New full suite patch: https://spruce.mongodb.com/version/684a917f27c4e80007fbc250
🌲💚 ALL GREEN! 🌲💚

@rozza rozza requested a review from katcharov June 12, 2025 08:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants