Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[DO NOT MERGE] Airspeed velocity performance regression CI #661

Open
wants to merge 47 commits into
base: main
Choose a base branch
from
Open

[DO NOT MERGE] Airspeed velocity performance regression CI #661

wants to merge 47 commits into from

Conversation

iomaganaris
Copy link
Collaborator

No description provided.

@iomaganaris
Copy link
Collaborator Author

cscs-ci run benchmark_asv

@iomaganaris
Copy link
Collaborator Author

cscs-ci run benchmark

@iomaganaris
Copy link
Collaborator Author

cscs-ci run benchmark

@iomaganaris
Copy link
Collaborator Author

cscs-ci run benchmark

@iomaganaris
Copy link
Collaborator Author

cscs-ci run benchmarkcscs-ci run benchmark

@iomaganaris
Copy link
Collaborator Author

cscs-ci run benchmark

@github-actions GitHub Actions
Copy link

github-actions bot commented Feb 7, 2025

Mandatory Tests

Please make sure you run these tests via comment before you merge!

  • cscs-ci run default
  • launch jenkins spack

Optional Tests

To run benchmarks you can use:

  • cscs-ci run benchmark

To run tests and benchmarks with the DaCe backend you can use:

  • cscs-ci run dace

In case your change might affect downstream icon-exclaim, please consider running

  • launch jenkins icon

For more detailed information please look at CI in the EXCLAIM universe.

@iomaganaris
Copy link
Collaborator Author

cscs-ci run benchmark

@iomaganaris
Copy link
Collaborator Author

cscs-ci run benchmark

@iomaganaris
Copy link
Collaborator Author

cscs-ci run benchmark

@iomaganaris
Copy link
Collaborator Author

cscs-ci run benchmark

@iomaganaris
Copy link
Collaborator Author

cscs-ci run benchmark

@iomaganaris
Copy link
Collaborator Author

cscs-ci run benchmark

@iomaganaris
Copy link
Collaborator Author

cscs-ci run benchmark

@iomaganaris
Copy link
Collaborator Author

cscs-ci run benchmark

@iomaganaris
Copy link
Collaborator Author

cscs-ci run benchmark

@iomaganaris
Copy link
Collaborator Author

cscs-ci run benchmark

@iomaganaris
Copy link
Collaborator Author

cscs-ci run benchmark

@iomaganaris
Copy link
Collaborator Author

cscs-ci run benchmark

@iomaganaris
Copy link
Collaborator Author

Benchmarks that have stayed the same:

Change Before [c714693] After [e238b62] Ratio Benchmark (Parameter)
failed failed n/a Benchmarks.track_memory_TestFusedVelocityAdvectionStencil15To18_ [gh200/virtualenv-py3.10-cupy-cuda12x-git+https___github.com_iomaganaris_pytest-memray.git@pytest_json-nvidia-cuda-runtime-cu12==12.6.77-pytest-pytest-benchmark-uv-GT4PY_BACKENDgtfn_cpu-ICON4PY_GRIDicon_grid]
109.27585983276367 109.27585983276367 1.00 Benchmarks.track_memory_TestFusedVelocityAdvectionStencil15To18_ [gh200/virtualenv-py3.10-cupy-cuda12x-git+https___github.com_iomaganaris_pytest-memray.git@pytest_json-nvidia-cuda-runtime-cu12==12.6.77-pytest-pytest-benchmark-uv-GT4PY_BACKENDgtfn_cpu-ICON4PY_GRIDicon_grid-MEMRAYON]
failed failed n/a Benchmarks.track_memory_TestFusedVelocityAdvectionStencil15To18_ [gh200/virtualenv-py3.10-cupy-cuda12x-git+https___github.com_iomaganaris_pytest-memray.git@pytest_json-nvidia-cuda-runtime-cu12==12.6.77-pytest-pytest-benchmark-uv-GT4PY_BACKENDgtfn_cpu-ICON4PY_GRIDicon_grid_global]
100.21540832519531 100.21540832519531 1.00 Benchmarks.track_memory_TestFusedVelocityAdvectionStencil15To18_ [gh200/virtualenv-py3.10-cupy-cuda12x-git+https___github.com_iomaganaris_pytest-memray.git@pytest_json-nvidia-cuda-runtime-cu12==12.6.77-pytest-pytest-benchmark-uv-GT4PY_BACKENDgtfn_cpu-ICON4PY_GRIDicon_grid_global-MEMRAYON]
failed failed n/a Benchmarks.track_memory_TestFusedVelocityAdvectionStencil15To18_ [gh200/virtualenv-py3.10-cupy-cuda12x-git+https___github.com_iomaganaris_pytest-memray.git@pytest_json-nvidia-cuda-runtime-cu12==12.6.77-pytest-pytest-benchmark-uv-GT4PY_BACKENDgtfn_gpu-ICON4PY_GRIDicon_grid]
failed failed n/a Benchmarks.track_memory_TestFusedVelocityAdvectionStencil15To18_ [gh200/virtualenv-py3.10-cupy-cuda12x-git+https___github.com_iomaganaris_pytest-memray.git@pytest_json-nvidia-cuda-runtime-cu12==12.6.77-pytest-pytest-benchmark-uv-GT4PY_BACKENDgtfn_gpu-ICON4PY_GRIDicon_grid_global]
0.035263876896351576 0.03416009095963091 0.97 Benchmarks.track_runtime_TestFusedVelocityAdvectionStencil15To18_ [gh200/virtualenv-py3.10-cupy-cuda12x-git+https___github.com_iomaganaris_pytest-memray.git@pytest_json-nvidia-cuda-runtime-cu12==12.6.77-pytest-pytest-benchmark-uv-GT4PY_BACKENDgtfn_cpu-ICON4PY_GRIDicon_grid]
failed failed n/a Benchmarks.track_runtime_TestFusedVelocityAdvectionStencil15To18_ [gh200/virtualenv-py3.10-cupy-cuda12x-git+https___github.com_iomaganaris_pytest-memray.git@pytest_json-nvidia-cuda-runtime-cu12==12.6.77-pytest-pytest-benchmark-uv-GT4PY_BACKENDgtfn_cpu-ICON4PY_GRIDicon_grid-MEMRAYON]
0.034143799217417836 0.034284597961232066 1.00 Benchmarks.track_runtime_TestFusedVelocityAdvectionStencil15To18_ [gh200/virtualenv-py3.10-cupy-cuda12x-git+https___github.com_iomaganaris_pytest-memray.git@pytest_json-nvidia-cuda-runtime-cu12==12.6.77-pytest-pytest-benchmark-uv-GT4PY_BACKENDgtfn_cpu-ICON4PY_GRIDicon_grid_global]
failed failed n/a Benchmarks.track_runtime_TestFusedVelocityAdvectionStencil15To18_ [gh200/virtualenv-py3.10-cupy-cuda12x-git+https___github.com_iomaganaris_pytest-memray.git@pytest_json-nvidia-cuda-runtime-cu12==12.6.77-pytest-pytest-benchmark-uv-GT4PY_BACKENDgtfn_cpu-ICON4PY_GRIDicon_grid_global-MEMRAYON]
0.03257811698131263 0.032969961990602314 1.01 Benchmarks.track_runtime_TestFusedVelocityAdvectionStencil15To18_ [gh200/virtualenv-py3.10-cupy-cuda12x-git+https___github.com_iomaganaris_pytest-memray.git@pytest_json-nvidia-cuda-runtime-cu12==12.6.77-pytest-pytest-benchmark-uv-GT4PY_BACKENDgtfn_gpu-ICON4PY_GRIDicon_grid]
0.03307577990926802 0.03318904899060726 1.00 Benchmarks.track_runtime_TestFusedVelocityAdvectionStencil15To18_ [gh200/virtualenv-py3.10-cupy-cuda12x-git+https___github.com_iomaganaris_pytest-memray.git@pytest_json-nvidia-cuda-runtime-cu12==12.6.77-pytest-pytest-benchmark-uv-GT4PY_BACKENDgtfn_gpu-ICON4PY_GRIDicon_grid_global]

@iomaganaris
Copy link
Collaborator Author

cscs-ci run benchmark

@iomaganaris
Copy link
Collaborator Author

cscs-ci run benchmark

@iomaganaris
Copy link
Collaborator Author

Benchmarks that have improved:

Change Before [c714693] <asv_test~18> After [e238b62] <asv_test~13> Ratio Benchmark (Parameter)
- 0.0352639 0.0341601 0.97 Benchmarks.track_runtime_TestFusedVelocityAdvectionStencil15To18_ [gh200/virtualenv-py3.10-cupy-cuda12x-git+https___github.com_iomaganaris_pytest-memray.git@pytest_json-nvidia-cuda-runtime-cu12==12.6.77-pytest-pytest-benchmark-uv-GT4PY_BACKENDgtfn_cpu-ICON4PY_GRIDicon_grid]

Benchmarks that have stayed the same:

Change Before [c714693] <asv_test~18> After [e238b62] <asv_test~13> Ratio Benchmark (Parameter)
failed failed n/a Benchmarks.track_memory_TestFusedVelocityAdvectionStencil15To18_ [gh200/virtualenv-py3.10-cupy-cuda12x-git+https___github.com_iomaganaris_pytest-memray.git@pytest_json-nvidia-cuda-runtime-cu12==12.6.77-pytest-pytest-benchmark-uv-GT4PY_BACKENDgtfn_cpu-ICON4PY_GRIDicon_grid]
109.27585983276367 109.27585983276367 1.00 Benchmarks.track_memory_TestFusedVelocityAdvectionStencil15To18_ [gh200/virtualenv-py3.10-cupy-cuda12x-git+https___github.com_iomaganaris_pytest-memray.git@pytest_json-nvidia-cuda-runtime-cu12==12.6.77-pytest-pytest-benchmark-uv-GT4PY_BACKENDgtfn_cpu-ICON4PY_GRIDicon_grid-MEMRAYON]
failed failed n/a Benchmarks.track_memory_TestFusedVelocityAdvectionStencil15To18_ [gh200/virtualenv-py3.10-cupy-cuda12x-git+https___github.com_iomaganaris_pytest-memray.git@pytest_json-nvidia-cuda-runtime-cu12==12.6.77-pytest-pytest-benchmark-uv-GT4PY_BACKENDgtfn_cpu-ICON4PY_GRIDicon_grid_global]
100.21540832519531 100.21540832519531 1.00 Benchmarks.track_memory_TestFusedVelocityAdvectionStencil15To18_ [gh200/virtualenv-py3.10-cupy-cuda12x-git+https___github.com_iomaganaris_pytest-memray.git@pytest_json-nvidia-cuda-runtime-cu12==12.6.77-pytest-pytest-benchmark-uv-GT4PY_BACKENDgtfn_cpu-ICON4PY_GRIDicon_grid_global-MEMRAYON]
failed failed n/a Benchmarks.track_memory_TestFusedVelocityAdvectionStencil15To18_ [gh200/virtualenv-py3.10-cupy-cuda12x-git+https___github.com_iomaganaris_pytest-memray.git@pytest_json-nvidia-cuda-runtime-cu12==12.6.77-pytest-pytest-benchmark-uv-GT4PY_BACKENDgtfn_gpu-ICON4PY_GRIDicon_grid]
failed failed n/a Benchmarks.track_memory_TestFusedVelocityAdvectionStencil15To18_ [gh200/virtualenv-py3.10-cupy-cuda12x-git+https___github.com_iomaganaris_pytest-memray.git@pytest_json-nvidia-cuda-runtime-cu12==12.6.77-pytest-pytest-benchmark-uv-GT4PY_BACKENDgtfn_gpu-ICON4PY_GRIDicon_grid_global]
failed failed n/a Benchmarks.track_runtime_TestFusedVelocityAdvectionStencil15To18_ [gh200/virtualenv-py3.10-cupy-cuda12x-git+https___github.com_iomaganaris_pytest-memray.git@pytest_json-nvidia-cuda-runtime-cu12==12.6.77-pytest-pytest-benchmark-uv-GT4PY_BACKENDgtfn_cpu-ICON4PY_GRIDicon_grid-MEMRAYON]
0.034143799217417836 0.034284597961232066 1.00 Benchmarks.track_runtime_TestFusedVelocityAdvectionStencil15To18_ [gh200/virtualenv-py3.10-cupy-cuda12x-git+https___github.com_iomaganaris_pytest-memray.git@pytest_json-nvidia-cuda-runtime-cu12==12.6.77-pytest-pytest-benchmark-uv-GT4PY_BACKENDgtfn_cpu-ICON4PY_GRIDicon_grid_global]
failed failed n/a Benchmarks.track_runtime_TestFusedVelocityAdvectionStencil15To18_ [gh200/virtualenv-py3.10-cupy-cuda12x-git+https___github.com_iomaganaris_pytest-memray.git@pytest_json-nvidia-cuda-runtime-cu12==12.6.77-pytest-pytest-benchmark-uv-GT4PY_BACKENDgtfn_cpu-ICON4PY_GRIDicon_grid_global-MEMRAYON]
0.03307577990926802 0.03318904899060726 1.00 Benchmarks.track_runtime_TestFusedVelocityAdvectionStencil15To18_ [gh200/virtualenv-py3.10-cupy-cuda12x-git+https___github.com_iomaganaris_pytest-memray.git@pytest_json-nvidia-cuda-runtime-cu12==12.6.77-pytest-pytest-benchmark-uv-GT4PY_BACKENDgtfn_gpu-ICON4PY_GRIDicon_grid_global]

Benchmarks that have got worse:

Change Before [c714693] <asv_test~18> After [e238b62] <asv_test~13> Ratio Benchmark (Parameter)
+ 0.0325781 0.03297 1.01 Benchmarks.track_runtime_TestFusedVelocityAdvectionStencil15To18_ [gh200/virtualenv-py3.10-cupy-cuda12x-git+https___github.com_iomaganaris_pytest-memray.git@pytest_json-nvidia-cuda-runtime-cu12==12.6.77-pytest-pytest-benchmark-uv-GT4PY_BACKENDgtfn_gpu-ICON4PY_GRIDicon_grid]

@iomaganaris
Copy link
Collaborator Author

cscs-ci run benchmark

@iomaganaris
Copy link
Collaborator Author

Change Before [c714693] After [e238b62] Ratio Benchmark (Parameter)
- 0.0352639 0.0341601 0.97 Benchmarks.track_runtime_TestFusedVelocityAdvectionStencil15To18_ [gh200/virtualenv-py3.10-cupy-cuda12x-git+https___github.com_iomaganaris_pytest-memray.git@pytest_json-nvidia-cuda-runtime-cu12==12.6.77-pytest-pytest-benchmark-uv-GT4PY_BACKENDgtfn_cpu-ICON4PY_GRIDicon_grid]
Change Before [c714693] After [e238b62] Ratio Benchmark (Parameter)
---------- ---------------------- --------------------- --------- ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
+ 0.0325781 0.03297 1.01 Benchmarks.track_runtime_TestFusedVelocityAdvectionStencil15To18_ [gh200/virtualenv-py3.10-cupy-cuda12x-git+https___github.com_iomaganaris_pytest-memray.git@pytest_json-nvidia-cuda-runtime-cu12==12.6.77-pytest-pytest-benchmark-uv-GT4PY_BACKENDgtfn_gpu-ICON4PY_GRIDicon_grid]

@iomaganaris
Copy link
Collaborator Author

cscs-ci run benchmark

@iomaganaris
Copy link
Collaborator Author

cscs-ci run benchmark

@iomaganaris
Copy link
Collaborator Author

Benchmarks that have improved:

Change Before [c714693] <asv_test~22> After [e238b62] <asv_test~17> Ratio Benchmark (Parameter)
- 0.0352639 0.0341601 0.97 Benchmarks.track_runtime_TestFusedVelocityAdvectionStencil15To18_ [gh200/virtualenv-py3.10-cupy-cuda12x-git+https___github.com_iomaganaris_pytest-memray.git@pytest_json-nvidia-cuda-runtime-cu12==12.6.77-pytest-pytest-benchmark-uv-GT4PY_BACKENDgtfn_cpu-ICON4PY_GRIDicon_grid]

Benchmarks that have got worse:

Change Before [c714693] <asv_test~22> After [e238b62] <asv_test~17> Ratio Benchmark (Parameter)
+ 0.0325781 0.03297 1.01 Benchmarks.track_runtime_TestFusedVelocityAdvectionStencil15To18_ [gh200/virtualenv-py3.10-cupy-cuda12x-git+https___github.com_iomaganaris_pytest-memray.git@pytest_json-nvidia-cuda-runtime-cu12==12.6.77-pytest-pytest-benchmark-uv-GT4PY_BACKENDgtfn_gpu-ICON4PY_GRIDicon_grid]

@iomaganaris
Copy link
Collaborator Author

cscs-ci run benchmark

@iomaganaris
Copy link
Collaborator Author

Benchmarks that have improved:

Change Before [c714693] <asv_test~23> After [e238b62] <asv_test~18> Ratio Benchmark (Parameter)
- 0.0352639 0.0341601 0.97 Benchmarks.track_runtime_TestFusedVelocityAdvectionStencil15To18_ [gh200/virtualenv-py3.10-cupy-cuda12x-git+https___github.com_iomaganaris_pytest-memray.git@pytest_json-nvidia-cuda-runtime-cu12==12.6.77-pytest-pytest-benchmark-uv-GT4PY_BACKENDgtfn_cpu-ICON4PY_GRIDicon_grid]

Benchmarks that have got worse:

Change Before [c714693] <asv_test~23> After [e238b62] <asv_test~18> Ratio Benchmark (Parameter)
+ 0.0325781 0.03297 1.01 Benchmarks.track_runtime_TestFusedVelocityAdvectionStencil15To18_ [gh200/virtualenv-py3.10-cupy-cuda12x-git+https___github.com_iomaganaris_pytest-memray.git@pytest_json-nvidia-cuda-runtime-cu12==12.6.77-pytest-pytest-benchmark-uv-GT4PY_BACKENDgtfn_gpu-ICON4PY_GRIDicon_grid]

@iomaganaris
Copy link
Collaborator Author

cscs-ci run benchmark

@iomaganaris
Copy link
Collaborator Author

Benchmarks that have improved:

Change Before [c714693] <asv_test~24> After [e238b62] <asv_test~19> Ratio Benchmark (Parameter)
- 0.0352639 0.0341601 0.97 Benchmarks.track_runtime_TestFusedVelocityAdvectionStencil15To18_ [gh200/virtualenv-py3.10-cupy-cuda12x-git+https___github.com_iomaganaris_pytest-memray.git@pytest_json-nvidia-cuda-runtime-cu12==12.6.77-pytest-pytest-benchmark-uv-GT4PY_BACKENDgtfn_cpu-ICON4PY_GRIDicon_grid]

Benchmarks that have got worse:

Change Before [c714693] <asv_test~24> After [e238b62] <asv_test~19> Ratio Benchmark (Parameter)
+ 0.0325781 0.03297 1.01 Benchmarks.track_runtime_TestFusedVelocityAdvectionStencil15To18_ [gh200/virtualenv-py3.10-cupy-cuda12x-git+https___github.com_iomaganaris_pytest-memray.git@pytest_json-nvidia-cuda-runtime-cu12==12.6.77-pytest-pytest-benchmark-uv-GT4PY_BACKENDgtfn_gpu-ICON4PY_GRIDicon_grid]

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@iomaganaris