Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add CI to build mulled containers with Wave #4080

Merged
merged 85 commits into from
Nov 7, 2024
Merged

Add CI to build mulled containers with Wave #4080

merged 85 commits into from
Nov 7, 2024
+157 −10

Commits on Jun 18, 2024

  1. build: Add wave

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    1c7c4b9 View commit details
    Browse the repository at this point in the history

  2. build: Set strategy to dockerfile, conda then container

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    112c9e6 View commit details
    Browse the repository at this point in the history

  3. refactor: Remove container

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    9d61b64 View commit details
    Browse the repository at this point in the history

  4. build: Add a repo to push to

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    cf3aa94 View commit details
    Browse the repository at this point in the history

  5. ci(wave): Add wave build 

    https://github.com/nodejs/docker-node/blob/3c4fa6daf06a4786d202f2f610351837806a0380/.github/workflows/build-test.yml#L29
    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    73d6d6f View commit details
    Browse the repository at this point in the history

  6. ci(wave): Switch to all_changed_files

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    83f1e30 View commit details
    Browse the repository at this point in the history

  7. ci(wave): Only look for envronment.ymls

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    95d0069 View commit details
    Browse the repository at this point in the history

  8. dummy: Change env

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    649214d View commit details
    Browse the repository at this point in the history

  9. ci(wave): Remove raw format

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    a4f4611 View commit details
    Browse the repository at this point in the history

  10. ci(wave): Try a bunch of different things at once

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    aa02e1b View commit details
    Browse the repository at this point in the history

  11. ci(wave): Remove redundant fromJson and wrap in an array

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    b37919c View commit details
    Browse the repository at this point in the history

  12. ci(wave): I have no idea what I'm doing

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    42e9f9e View commit details
    Browse the repository at this point in the history

  13. ci(wave): Wrap it

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    abdbc57 View commit details
    Browse the repository at this point in the history

  14. ci(wave): Found an example 

    https://github.com/tj-actions/changed-files/blob/main/.github/workflows/matrix-test.yml
    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    06188dd View commit details
    Browse the repository at this point in the history

  15. ci(wave): Maybe quotes?

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    72275d6 View commit details
    Browse the repository at this point in the history

  16. ci(wave): That'll do it

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    bd0bdb0 View commit details
    Browse the repository at this point in the history

  17. ci(wave): Fix wave install

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    8333d50 View commit details
    Browse the repository at this point in the history

  18. ci(wave): Hard code an image

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    95ec7e4 View commit details
    Browse the repository at this point in the history

  19. ci(wave): Add secrets

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    f20da94 View commit details
    Browse the repository at this point in the history

  20. feat: Try a different files structure

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    4fe3bbd View commit details
    Browse the repository at this point in the history

  21. ci(wave): First stab at building singularity images

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    7f84d8a View commit details
    Browse the repository at this point in the history

  22. fixup! feat: Try a different files structure

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    c80e959 View commit details
    Browse the repository at this point in the history

  23. ci(wave): Add profile to matrix

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    15b163d View commit details
    Browse the repository at this point in the history

  24. ci(wave): Give up on fancy substitution

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    a08373d View commit details
    Browse the repository at this point in the history

  25. ci(wave): Add await 

    Co-authored-by: ewels <[email protected]>
    @edmundmiller @ewels
    edmundmiller and ewels committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    960702f View commit details
    Browse the repository at this point in the history

  26. ci(wave): Switch to quay

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    9a3f93e View commit details
    Browse the repository at this point in the history

  27. test(wave): Add freeze and update build repo

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    4c92894 View commit details
    Browse the repository at this point in the history

  28. refactor(wave): What happens if I add a container?

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    1cd2efe View commit details
    Browse the repository at this point in the history

  29. refactor(wave): Have both bowtie modules use the same env 

    For the sake of demonstration
    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    6386a76 View commit details
    Browse the repository at this point in the history

  30. test: Cut out using wave on tests

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    8aec35d View commit details
    Browse the repository at this point in the history

  31. refactor: What happens if we use the singularity one?

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    5a8fcc9 View commit details
    Browse the repository at this point in the history

  32. refactor: Keep container directives for offline download 

    seqeralabs/wave#323
    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    9b8ddfd View commit details
    Browse the repository at this point in the history

  33. feat: Try new singularity OCI setting 

    nextflow-io/nextflow@f5362a7
    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    7b12cd7 View commit details
    Browse the repository at this point in the history

  34. build: Update container name 

    Guess #4327 broke that
    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    cac8b9f View commit details
    Browse the repository at this point in the history

  35. chore: Bump wave-cli version

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    75464b3 View commit details
    Browse the repository at this point in the history

  36. ci: Install runc

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    f588f18 View commit details
    Browse the repository at this point in the history

  37. ci: Switch to singularityhub action 

    nextflow-io/nextflow#4543
    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    f4144ac View commit details
    Browse the repository at this point in the history

  38. ci: Install new singularity manually 

    Why that action trys to build from source, idk.
    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    8ea536e View commit details
    Browse the repository at this point in the history

  39. ci: Install dependancies for singularity

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    d6437f8 View commit details
    Browse the repository at this point in the history

  40. ci: runc => crun

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    265abdf View commit details
    Browse the repository at this point in the history

  41. ci: Fix cgroup error 

    https://blog.misharov.pro/2021-05-16/systemd-github-actions
    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    00313f3 View commit details
    Browse the repository at this point in the history

  42. ci: That'll do it

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    04dd852 View commit details
    Browse the repository at this point in the history

  43. ci: Remove Dockerfile 

    We'll have a seperate action for this I think
    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    1127407 View commit details
    Browse the repository at this point in the history

  44. ci: Update name

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    7b241f1 View commit details
    Browse the repository at this point in the history

  45. ci: Push to the correct repos

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    2c3a787 View commit details
    Browse the repository at this point in the history

  46. ci: Remove OCI stuff

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    895c72f View commit details
    Browse the repository at this point in the history

  47. ci: Need a full URL

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    34852d9 View commit details
    Browse the repository at this point in the history

  48. ci: Fix // in container name

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    154fdda View commit details
    Browse the repository at this point in the history

  49. ci: Remove push 

    Build once, renovate should bump the images automagically
    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    f3276d1 View commit details
    Browse the repository at this point in the history

  50. build: Add containers back

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    66ebb14 View commit details
    Browse the repository at this point in the history

  51. ci: Add cache repos 

    Idk what this does exactly
    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    3394c98 View commit details
    Browse the repository at this point in the history

  52. ci: Change registry name to use _ 

    Because "build" is a api end point on quay.io.

So `bowtie/build` doesn't work.

Other plus is this matches the conda env name.
    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    cfc8528 View commit details
    Browse the repository at this point in the history

  53. build: / => _ in container name

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    c20dad0 View commit details
    Browse the repository at this point in the history

  54. Try ociAutoPull

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    7b0b40b View commit details
    Browse the repository at this point in the history

  55. chore: Add renovate comments to samtools 

    Just to trigger wave build
    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    b3488fb View commit details
    Browse the repository at this point in the history

  56. test: Add ociAutoPull to nf-test

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    5a3d546 View commit details
    Browse the repository at this point in the history

  57. ci: Bump wave version

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    a3753e7 View commit details
    Browse the repository at this point in the history

  58. chore: Bump containers with new wave version 

    Not sure why that's happening...
    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    0546a88 View commit details
    Browse the repository at this point in the history

  59. build: Update to use commity.wave.seqera.io

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    8995941 View commit details
    Browse the repository at this point in the history

  60. ci: Bump wave-cli to 1.4.1

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    08292ea View commit details
    Browse the repository at this point in the history

  61. ci: Try apptainer

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    bc4a8bc View commit details
    Browse the repository at this point in the history

  62. ci: Remove build-repo to see what happens

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    300502d View commit details
    Browse the repository at this point in the history

  63. build: Bump Nextflow version requirement

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    69e1ea5 View commit details
    Browse the repository at this point in the history

  64. fix: Get rid of the environment name? 

    Maybe this will get the auto generated tag?
    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    14aa295 View commit details
    Browse the repository at this point in the history

  65. ci: Bump action versions

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    ca5d48a View commit details
    Browse the repository at this point in the history

  66. ci: Try name-strategy tagPrefix 

    seqeralabs/wave-cli@269df0e
    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    4353d08 View commit details
    Browse the repository at this point in the history

  67. ci: Remove singularity build for now

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    b36b631 View commit details
    Browse the repository at this point in the history

  68. ci: Try imageSuffix

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    d0d8315 View commit details
    Browse the repository at this point in the history

  69. ci: Try none

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    2112a96 View commit details
    Browse the repository at this point in the history

  70. ci: What is the bowtie container name

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    5ef863f View commit details
    Browse the repository at this point in the history

  71. ci: Remove --name-strategy

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    ec74401 View commit details
    Browse the repository at this point in the history

  72. style: Add back in container elvis operator

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    364f7a6 View commit details
    Browse the repository at this point in the history

  73. ci: Remove cache repo

    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    a1e54b4 View commit details
    Browse the repository at this point in the history

  74. Revert "build: Bump Nextflow version requirement" 

    This reverts commit 69e1ea5.
    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    8fa7b0d View commit details
    Browse the repository at this point in the history

  75. Revert "test: Add ociAutoPull to nf-test" 

    This reverts commit 5a3d546.
    @edmundmiller
    edmundmiller committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    727dda0 View commit details
    Browse the repository at this point in the history

Commits on Sep 10, 2024

  1. test(#6505): Snapshot the versions contents, not the hash

    @edmundmiller
    edmundmiller committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    daa44fe View commit details
    Browse the repository at this point in the history

  2. ci(#6505): Update version snapshot after building containers

    @edmundmiller
    edmundmiller committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    457bf9e View commit details
    Browse the repository at this point in the history

  3. test(#6505): Attempt a topic channel with tests 

    askimed/nf-test#258
    @edmundmiller
    edmundmiller committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    2925c17 View commit details
    Browse the repository at this point in the history

Commits on Oct 30, 2024

  1. Merge remote-tracking branch 'origin/master' into wave

    @edmundmiller
    edmundmiller committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    455bc2d View commit details
    Browse the repository at this point in the history

  2. chore: Bump to 1.5.0

    @edmundmiller
    edmundmiller committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    2462a11 View commit details
    Browse the repository at this point in the history

  3. fix: Remove shard and filter on test bumping

    @edmundmiller
    edmundmiller committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    6934f0b View commit details
    Browse the repository at this point in the history

  4. build: Bump images to match environment

    @edmundmiller
    edmundmiller committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    3fa2c06 View commit details
    Browse the repository at this point in the history

  5. ci: Fix nf-test setup

    @edmundmiller
    edmundmiller committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    8c73e71 View commit details
    Browse the repository at this point in the history

Commits on Oct 31, 2024

  1. ci: Remove snapshot bumping

    @edmundmiller
    edmundmiller committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    24de614 View commit details
    Browse the repository at this point in the history

Commits on Nov 7, 2024

  1. build: Fix containers in bowtie

    @edmundmiller
    edmundmiller committed Nov 7, 2024
    Configuration menu
    Copy the full SHA
    86ad692 View commit details
    Browse the repository at this point in the history