Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Optimize sparse AD #269

Merged
merged 2 commits into from
Jul 11, 2024
Merged

Optimize sparse AD #269

merged 2 commits into from
Jul 11, 2024

Conversation

amontoison
Copy link
Member

No description provided.

@github-actions GitHub Actions
Copy link
Contributor

Package name latest stable
CaNNOLeS.jl
DCISolver.jl
DerivativeFreeSolvers.jl
JSOSolvers.jl
NLPModelsIpopt.jl
OptimalControl.jl
OptimizationProblems.jl
Percival.jl
QuadraticModels.jl
SolverBenchmark.jl
SolverTools.jl

@github-actions GitHub Actions
Copy link
Contributor

Benchmark result

Judge result

Benchmark Report for /home/runner/work/ADNLPModels.jl/ADNLPModels.jl

Job Properties

  • Time of benchmarks:
    • Target: 11 Jul 2024 - 20:26
    • Baseline: 11 Jul 2024 - 20:38
  • Package commits:
    • Target: 7133c2
    • Baseline: e89bd3
  • Julia commits:
    • Target: 48d4fd
    • Baseline: 48d4fd
  • Julia command flags:
    • Target: None
    • Baseline: None
  • Environment variables:
    • Target: None
    • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["jac_coord", "optimized", "Float32", "scalable", "sparse", "camshape"] 0.94 (5%) ✅ 1.00 (1%)
["jac_coord", "optimized", "Float32", "scalable", "sparse", "marine"] 0.94 (5%) ✅ 1.00 (1%)
["jac_coord", "optimized", "Float32", "scalable", "sparse", "polygon3"] 0.92 (5%) ✅ 1.00 (1%)
["jac_coord", "optimized", "Float32", "scalable", "sparse", "structural"] 0.79 (5%) ✅ 1.00 (1%)
["jac_coord", "optimized", "Float64", "scalable", "sparse", "hovercraft1d"] 0.88 (5%) ✅ 1.00 (1%)
["jac_coord", "optimized", "Float64", "scalable", "sparse", "polygon3"] 0.93 (5%) ✅ 1.00 (1%)
["jac_coord", "optimized", "Float64", "scalable", "sparse", "structural"] 0.81 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "arglina"] 0.94 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "arglinb"] 0.91 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "bdqrtic"] 0.93 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "brownal"] 0.95 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "broyden3d"] 0.85 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "dixon3dq"] 0.91 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "freuroth"] 0.95 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "hovercraft1d"] 0.89 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "penalty1"] 0.82 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "power"] 0.88 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "spmsrtls"] 0.93 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "tquartic"] 0.84 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "arglinb"] 0.89 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "bdqrtic"] 0.91 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "brownal"] 0.95 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "broyden3d"] 0.94 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "dixon3dq"] 0.90 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "freuroth"] 0.92 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "hovercraft1d"] 0.89 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "power"] 0.88 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "spmsrtls"] 0.94 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "tquartic"] 0.90 (5%) ✅ 1.00 (1%)
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "camshape"] 1.03 (5%) 1.02 (1%) ❌
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "catenary"] 1.05 (5%) ❌ 1.03 (1%) ❌
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "chain"] 1.03 (5%) 1.03 (1%) ❌
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "clnlbeam"] 1.07 (5%) ❌ 1.03 (1%) ❌
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "controlinvestment"] 1.06 (5%) ❌ 1.05 (1%) ❌
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "elec"] 1.07 (5%) ❌ 1.06 (1%) ❌
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "hovercraft1d"] 1.12 (5%) ❌ 1.08 (1%) ❌
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "marine"] 1.03 (5%) 1.04 (1%) ❌
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "polygon1"] 1.12 (5%) ❌ 1.10 (1%) ❌
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "polygon3"] 1.05 (5%) ❌ 1.05 (1%) ❌
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "robotarm"] 1.03 (5%) 1.03 (1%) ❌
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "structural"] 0.99 (5%) 1.02 (1%) ❌
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "hovercraft1d"] 1.05 (5%) 1.03 (1%) ❌
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "polygon1"] 1.00 (5%) 1.04 (1%) ❌
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "structural"] 0.99 (5%) 1.01 (1%) ❌

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["jac_coord", "optimized", "Float32", "scalable", "sparse"]
  • ["jac_coord", "optimized", "Float64", "scalable", "sparse"]
  • ["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse"]
  • ["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse"]
  • ["jacobian_backend", "optimized", "Float64", "scalable", "sparse"]
  • ["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics"]

Julia versioninfo

Target

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1023-azure #24~22.04.1-Ubuntu SMP Wed Jun 12 19:55:26 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2445 MHz       7488 s          0 s        363 s      12755 s          0 s
       #2  2595 MHz       7298 s          0 s        356 s      12950 s          0 s
       #3  3242 MHz       7543 s          0 s        394 s      12675 s          0 s
       #4  2445 MHz       7055 s          0 s        368 s      13179 s          0 s
  Memory: 15.606491088867188 GB (13248.20703125 MB free)
  Uptime: 2065.64 sec
  Load Avg:  1.11  1.09  1.22
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1023-azure #24~22.04.1-Ubuntu SMP Wed Jun 12 19:55:26 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2836 MHz       9483 s          0 s        437 s      17668 s          0 s
       #2  2445 MHz       9306 s          0 s        434 s      17847 s          0 s
       #3  3243 MHz       9056 s          0 s        480 s      18060 s          0 s
       #4  3228 MHz       8631 s          0 s        450 s      18505 s          0 s
  Memory: 15.606491088867188 GB (13350.42578125 MB free)
  Uptime: 2765.34 sec
  Load Avg:  1.08  1.05  1.11
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/ADNLPModels.jl/ADNLPModels.jl

Job Properties

  • Time of benchmark: 11 Jul 2024 - 20:26
  • Package commit: 7133c2
  • Julia commit: 48d4fd
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["jac_coord", "optimized", "Float32", "scalable", "sparse", "camshape"] 36.799 μs (5%) 32.47 KiB (1%) 10
["jac_coord", "optimized", "Float32", "scalable", "sparse", "catenary"] 21.440 μs (5%) 33.36 KiB (1%) 12
["jac_coord", "optimized", "Float32", "scalable", "sparse", "chain"] 33.853 μs (5%) 39.23 KiB (1%) 12
["jac_coord", "optimized", "Float32", "scalable", "sparse", "channel"] 1.722 ms (5%) 64.09 KiB (1%) 15
["jac_coord", "optimized", "Float32", "scalable", "sparse", "clnlbeam"] 41.868 μs (5%) 27.55 KiB (1%) 10
["jac_coord", "optimized", "Float32", "scalable", "sparse", "controlinvestment"] 88.134 μs (5%) 24.98 KiB (1%) 10
["jac_coord", "optimized", "Float32", "scalable", "sparse", "elec"] 11.221 μs (5%) 16.92 KiB (1%) 9
["jac_coord", "optimized", "Float32", "scalable", "sparse", "hovercraft1d"] 490.383 ns (5%) 7.94 KiB (1%) 1
["jac_coord", "optimized", "Float32", "scalable", "sparse", "marine"] 37.420 μs (5%) 33.86 KiB (1%) 12
["jac_coord", "optimized", "Float32", "scalable", "sparse", "polygon1"] 316.085 ns (5%) 4.06 KiB (1%) 1
["jac_coord", "optimized", "Float32", "scalable", "sparse", "polygon3"] 16.310 μs (5%) 28.92 KiB (1%) 10
["jac_coord", "optimized", "Float32", "scalable", "sparse", "robotarm"] 35.336 μs (5%) 38.61 KiB (1%) 12
["jac_coord", "optimized", "Float32", "scalable", "sparse", "structural"] 2.812 μs (5%) 50.48 KiB (1%) 2
["jac_coord", "optimized", "Float64", "scalable", "sparse", "camshape"] 44.513 μs (5%) 51.97 KiB (1%) 10
["jac_coord", "optimized", "Float64", "scalable", "sparse", "catenary"] 25.247 μs (5%) 41.11 KiB (1%) 12
["jac_coord", "optimized", "Float64", "scalable", "sparse", "chain"] 44.744 μs (5%) 52.78 KiB (1%) 13
["jac_coord", "optimized", "Float64", "scalable", "sparse", "channel"] 2.063 ms (5%) 94.34 KiB (1%) 15
["jac_coord", "optimized", "Float64", "scalable", "sparse", "clnlbeam"] 45.124 μs (5%) 37.84 KiB (1%) 11
["jac_coord", "optimized", "Float64", "scalable", "sparse", "controlinvestment"] 90.078 μs (5%) 32.80 KiB (1%) 10
["jac_coord", "optimized", "Float64", "scalable", "sparse", "elec"] 12.083 μs (5%) 20.80 KiB (1%) 9
["jac_coord", "optimized", "Float64", "scalable", "sparse", "hovercraft1d"] 905.483 ns (5%) 15.75 KiB (1%) 1
["jac_coord", "optimized", "Float64", "scalable", "sparse", "marine"] 41.577 μs (5%) 42.03 KiB (1%) 13
["jac_coord", "optimized", "Float64", "scalable", "sparse", "polygon1"] 468.262 ns (5%) 7.94 KiB (1%) 1
["jac_coord", "optimized", "Float64", "scalable", "sparse", "polygon3"] 19.837 μs (5%) 40.53 KiB (1%) 11
["jac_coord", "optimized", "Float64", "scalable", "sparse", "robotarm"] 37.841 μs (5%) 51.53 KiB (1%) 13
["jac_coord", "optimized", "Float64", "scalable", "sparse", "structural"] 5.434 μs (5%) 100.86 KiB (1%) 2
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "arglina"] 35.261 ms (5%) 11.72 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "arglinb"] 5.864 ms (5%) 11.72 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "bdqrtic"] 31.779 μs (5%) 44.52 KiB (1%) 9
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "brownal"] 7.849 ms (5%) 7.90 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "broyden3d"] 11.922 μs (5%) 24.59 KiB (1%) 6
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "brybnd"] 124.632 μs (5%) 56.83 KiB (1%) 11
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "dixon3dq"] 7.527 μs (5%) 16.47 KiB (1%) 5
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "errinros_mod"] 30.586 μs (5%) 20.41 KiB (1%) 5
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "freuroth"] 15.108 μs (5%) 24.28 KiB (1%) 5
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "hovercraft1d"] 3.747 μs (5%) 5.80 KiB (1%) 4
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "integreq"] 37.868 s (5%) 7.90 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "morebv"] 194.192 μs (5%) 24.59 KiB (1%) 6
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "penalty1"] 3.010 ms (5%) 4.10 MiB (1%) 1003
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "power"] 2.691 ms (5%) 4.09 MiB (1%) 1003
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "sbrybnd"] 143.788 μs (5%) 56.83 KiB (1%) 11
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "spmsrtls"] 29.815 μs (5%) 36.45 KiB (1%) 8
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "tquartic"] 8.242 μs (5%) 16.47 KiB (1%) 5
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "arglina"] 37.485 ms (5%) 1.032 ms 19.35 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "arglinb"] 8.224 ms (5%) 1.045 ms 19.35 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "bdqrtic"] 34.745 μs (5%) 67.83 KiB (1%) 9
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "brownal"] 6.335 ms (5%) 11.72 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "broyden3d"] 14.797 μs (5%) 36.20 KiB (1%) 7
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "brybnd"] 144.430 μs (5%) 84.08 KiB (1%) 11
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "dixon3dq"] 8.302 μs (5%) 24.28 KiB (1%) 5
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "errinros_mod"] 35.937 μs (5%) 32.02 KiB (1%) 6
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "freuroth"] 15.989 μs (5%) 39.83 KiB (1%) 6
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "hovercraft1d"] 3.907 μs (5%) 7.09 KiB (1%) 4
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "integreq"] 41.668 s (5%) 11.72 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "morebv"] 197.128 μs (5%) 36.20 KiB (1%) 7
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "penalty1"] 3.841 ms (5%) 4.10 MiB (1%) 1003
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "power"] 2.700 ms (5%) 4.10 MiB (1%) 1003
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "sbrybnd"] 141.264 μs (5%) 84.08 KiB (1%) 11
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "spmsrtls"] 31.158 μs (5%) 55.95 KiB (1%) 8
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "tquartic"] 9.578 μs (5%) 24.28 KiB (1%) 5
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "camshape"] 807.155 μs (5%) 1.82 MiB (1%) 15297
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "catenary"] 435.032 μs (5%) 842.50 KiB (1%) 6892
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "chain"] 542.863 μs (5%) 1.38 MiB (1%) 8642
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "channel"] 2.610 ms (5%) 4.20 MiB (1%) 48965
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "clnlbeam"] 309.688 μs (5%) 817.39 KiB (1%) 5628
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "controlinvestment"] 496.827 μs (5%) 1.29 MiB (1%) 10287
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "elec"] 271.587 μs (5%) 773.41 KiB (1%) 5603
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "hovercraft1d"] 164.086 μs (5%) 561.94 KiB (1%) 3278
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "marine"] 697.892 μs (5%) 1.17 MiB (1%) 11806
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "polygon1"] 153.457 μs (5%) 487.80 KiB (1%) 3259
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "polygon3"] 490.995 μs (5%) 1.21 MiB (1%) 9296
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "robotarm"] 552.981 μs (5%) 1.28 MiB (1%) 9951
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "structural"] 1.496 ms (5%) 6.96 MiB (1%) 14838
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "camshape"] 86.608 ms (5%) 45.75 MiB (1%) 748990
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "catenary"] 33.277 ms (5%) 17.07 MiB (1%) 272384
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "chain"] 52.740 ms (5%) 24.44 MiB (1%) 401898
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "channel"] 269.208 ms (5%) 14.924 ms 137.61 MiB (1%) 2309946
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "clnlbeam"] 20.882 ms (5%) 10.69 MiB (1%) 168628
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "controlinvestment"] 33.283 ms (5%) 18.37 MiB (1%) 299430
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "elec"] 13.174 ms (5%) 7.58 MiB (1%) 123505
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "hovercraft1d"] 1.595 ms (5%) 1.28 MiB (1%) 18767
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "marine"] 21.056 ms (5%) 11.89 MiB (1%) 191017
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "polygon1"] 1.583 ms (5%) 1.21 MiB (1%) 18780
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "polygon3"] 32.060 ms (5%) 16.90 MiB (1%) 284273
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "robotarm"] 46.230 ms (5%) 24.45 MiB (1%) 396786
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "structural"] 6.658 ms (5%) 9.63 MiB (1%) 70999

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["jac_coord", "optimized", "Float32", "scalable", "sparse"]
  • ["jac_coord", "optimized", "Float64", "scalable", "sparse"]
  • ["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse"]
  • ["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse"]
  • ["jacobian_backend", "optimized", "Float64", "scalable", "sparse"]
  • ["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics"]

Julia versioninfo

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1023-azure #24~22.04.1-Ubuntu SMP Wed Jun 12 19:55:26 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2445 MHz       7488 s          0 s        363 s      12755 s          0 s
       #2  2595 MHz       7298 s          0 s        356 s      12950 s          0 s
       #3  3242 MHz       7543 s          0 s        394 s      12675 s          0 s
       #4  2445 MHz       7055 s          0 s        368 s      13179 s          0 s
  Memory: 15.606491088867188 GB (13248.20703125 MB free)
  Uptime: 2065.64 sec
  Load Avg:  1.11  1.09  1.22
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/ADNLPModels.jl/ADNLPModels.jl

Job Properties

  • Time of benchmark: 11 Jul 2024 - 20:38
  • Package commit: e89bd3
  • Julia commit: 48d4fd
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["jac_coord", "optimized", "Float32", "scalable", "sparse", "camshape"] 38.963 μs (5%) 32.47 KiB (1%) 10
["jac_coord", "optimized", "Float32", "scalable", "sparse", "catenary"] 22.292 μs (5%) 33.36 KiB (1%) 12
["jac_coord", "optimized", "Float32", "scalable", "sparse", "chain"] 35.446 μs (5%) 39.23 KiB (1%) 12
["jac_coord", "optimized", "Float32", "scalable", "sparse", "channel"] 1.723 ms (5%) 64.09 KiB (1%) 15
["jac_coord", "optimized", "Float32", "scalable", "sparse", "clnlbeam"] 42.990 μs (5%) 27.55 KiB (1%) 10
["jac_coord", "optimized", "Float32", "scalable", "sparse", "controlinvestment"] 89.617 μs (5%) 24.98 KiB (1%) 10
["jac_coord", "optimized", "Float32", "scalable", "sparse", "elec"] 11.712 μs (5%) 16.92 KiB (1%) 9
["jac_coord", "optimized", "Float32", "scalable", "sparse", "hovercraft1d"] 509.941 ns (5%) 7.94 KiB (1%) 1
["jac_coord", "optimized", "Float32", "scalable", "sparse", "marine"] 39.864 μs (5%) 33.86 KiB (1%) 12
["jac_coord", "optimized", "Float32", "scalable", "sparse", "polygon1"] 325.770 ns (5%) 4.06 KiB (1%) 1
["jac_coord", "optimized", "Float32", "scalable", "sparse", "polygon3"] 17.743 μs (5%) 28.92 KiB (1%) 10
["jac_coord", "optimized", "Float32", "scalable", "sparse", "robotarm"] 37.099 μs (5%) 38.61 KiB (1%) 12
["jac_coord", "optimized", "Float32", "scalable", "sparse", "structural"] 3.579 μs (5%) 50.48 KiB (1%) 2
["jac_coord", "optimized", "Float64", "scalable", "sparse", "camshape"] 46.768 μs (5%) 51.97 KiB (1%) 10
["jac_coord", "optimized", "Float64", "scalable", "sparse", "catenary"] 25.968 μs (5%) 41.11 KiB (1%) 12
["jac_coord", "optimized", "Float64", "scalable", "sparse", "chain"] 45.735 μs (5%) 52.78 KiB (1%) 13
["jac_coord", "optimized", "Float64", "scalable", "sparse", "channel"] 2.073 ms (5%) 94.34 KiB (1%) 15
["jac_coord", "optimized", "Float64", "scalable", "sparse", "clnlbeam"] 46.286 μs (5%) 37.84 KiB (1%) 11
["jac_coord", "optimized", "Float64", "scalable", "sparse", "controlinvestment"] 90.719 μs (5%) 32.80 KiB (1%) 10
["jac_coord", "optimized", "Float64", "scalable", "sparse", "elec"] 12.694 μs (5%) 20.80 KiB (1%) 9
["jac_coord", "optimized", "Float64", "scalable", "sparse", "hovercraft1d"] 1.034 μs (5%) 15.75 KiB (1%) 1
["jac_coord", "optimized", "Float64", "scalable", "sparse", "marine"] 43.752 μs (5%) 42.03 KiB (1%) 13
["jac_coord", "optimized", "Float64", "scalable", "sparse", "polygon1"] 482.338 ns (5%) 7.94 KiB (1%) 1
["jac_coord", "optimized", "Float64", "scalable", "sparse", "polygon3"] 21.410 μs (5%) 40.53 KiB (1%) 11
["jac_coord", "optimized", "Float64", "scalable", "sparse", "robotarm"] 39.815 μs (5%) 51.53 KiB (1%) 13
["jac_coord", "optimized", "Float64", "scalable", "sparse", "structural"] 6.723 μs (5%) 100.86 KiB (1%) 2
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "arglina"] 37.421 ms (5%) 11.72 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "arglinb"] 6.472 ms (5%) 11.72 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "bdqrtic"] 34.164 μs (5%) 44.52 KiB (1%) 9
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "brownal"] 8.298 ms (5%) 7.90 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "broyden3d"] 13.986 μs (5%) 24.59 KiB (1%) 6
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "brybnd"] 128.089 μs (5%) 56.83 KiB (1%) 11
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "dixon3dq"] 8.275 μs (5%) 16.47 KiB (1%) 5
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "errinros_mod"] 31.969 μs (5%) 20.41 KiB (1%) 5
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "freuroth"] 15.970 μs (5%) 24.28 KiB (1%) 5
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "hovercraft1d"] 4.197 μs (5%) 5.80 KiB (1%) 4
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "integreq"] 37.881 s (5%) 7.90 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "morebv"] 195.695 μs (5%) 24.59 KiB (1%) 6
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "penalty1"] 3.668 ms (5%) 4.10 MiB (1%) 1003
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "power"] 3.046 ms (5%) 4.09 MiB (1%) 1003
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "sbrybnd"] 148.607 μs (5%) 56.83 KiB (1%) 11
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "spmsrtls"] 32.170 μs (5%) 36.45 KiB (1%) 8
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "tquartic"] 9.802 μs (5%) 16.47 KiB (1%) 5
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "arglina"] 36.333 ms (5%) 19.35 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "arglinb"] 9.217 ms (5%) 19.35 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "bdqrtic"] 38.361 μs (5%) 67.83 KiB (1%) 9
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "brownal"] 6.680 ms (5%) 11.72 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "broyden3d"] 15.800 μs (5%) 36.20 KiB (1%) 7
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "brybnd"] 149.309 μs (5%) 84.08 KiB (1%) 11
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "dixon3dq"] 9.241 μs (5%) 24.28 KiB (1%) 5
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "errinros_mod"] 37.289 μs (5%) 32.02 KiB (1%) 6
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "freuroth"] 17.313 μs (5%) 39.83 KiB (1%) 6
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "hovercraft1d"] 4.379 μs (5%) 7.09 KiB (1%) 4
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "integreq"] 41.730 s (5%) 11.72 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "morebv"] 199.763 μs (5%) 36.20 KiB (1%) 7
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "penalty1"] 4.006 ms (5%) 4.10 MiB (1%) 1003
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "power"] 3.077 ms (5%) 4.10 MiB (1%) 1003
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "sbrybnd"] 146.082 μs (5%) 84.08 KiB (1%) 11
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "spmsrtls"] 33.312 μs (5%) 55.95 KiB (1%) 8
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "tquartic"] 10.700 μs (5%) 24.28 KiB (1%) 5
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "camshape"] 780.386 μs (5%) 1.78 MiB (1%) 15278
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "catenary"] 412.900 μs (5%) 819.95 KiB (1%) 6864
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "chain"] 524.839 μs (5%) 1.34 MiB (1%) 8612
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "channel"] 2.578 ms (5%) 4.17 MiB (1%) 48929
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "clnlbeam"] 289.099 μs (5%) 791.06 KiB (1%) 5607
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "controlinvestment"] 467.729 μs (5%) 1.23 MiB (1%) 10263
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "elec"] 253.203 μs (5%) 728.51 KiB (1%) 5584
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "hovercraft1d"] 146.503 μs (5%) 518.12 KiB (1%) 3268
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "marine"] 677.655 μs (5%) 1.13 MiB (1%) 11776
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "polygon1"] 136.805 μs (5%) 443.98 KiB (1%) 3249
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "polygon3"] 466.861 μs (5%) 1.15 MiB (1%) 9272
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "robotarm"] 537.372 μs (5%) 1.24 MiB (1%) 9923
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "structural"] 1.508 ms (5%) 6.86 MiB (1%) 14827
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "camshape"] 86.698 ms (5%) 45.70 MiB (1%) 748971
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "catenary"] 33.241 ms (5%) 17.05 MiB (1%) 272356
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "chain"] 53.131 ms (5%) 24.40 MiB (1%) 401868
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "channel"] 281.643 ms (5%) 28.387 ms 137.58 MiB (1%) 2309910
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "clnlbeam"] 20.807 ms (5%) 10.61 MiB (1%) 167611
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "controlinvestment"] 33.625 ms (5%) 18.31 MiB (1%) 299406
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "elec"] 13.052 ms (5%) 7.53 MiB (1%) 123486
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "hovercraft1d"] 1.524 ms (5%) 1.24 MiB (1%) 18757
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "marine"] 21.379 ms (5%) 11.85 MiB (1%) 190987
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "polygon1"] 1.579 ms (5%) 1.17 MiB (1%) 18770
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "polygon3"] 32.447 ms (5%) 16.84 MiB (1%) 284249
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "robotarm"] 46.967 ms (5%) 24.41 MiB (1%) 396758
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "structural"] 6.747 ms (5%) 9.53 MiB (1%) 70988

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["jac_coord", "optimized", "Float32", "scalable", "sparse"]
  • ["jac_coord", "optimized", "Float64", "scalable", "sparse"]
  • ["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse"]
  • ["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse"]
  • ["jacobian_backend", "optimized", "Float64", "scalable", "sparse"]
  • ["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics"]

Julia versioninfo

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1023-azure #24~22.04.1-Ubuntu SMP Wed Jun 12 19:55:26 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2836 MHz       9483 s          0 s        437 s      17668 s          0 s
       #2  2445 MHz       9306 s          0 s        434 s      17847 s          0 s
       #3  3243 MHz       9056 s          0 s        480 s      18060 s          0 s
       #4  3228 MHz       8631 s          0 s        450 s      18505 s          0 s
  Memory: 15.606491088867188 GB (13350.42578125 MB free)
  Uptime: 2765.34 sec
  Load Avg:  1.08  1.05  1.11
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture:                       x86_64
CPU op-mode(s):                     32-bit, 64-bit
Address sizes:                      48 bits physical, 48 bits virtual
Byte Order:                         Little Endian
CPU(s):                             4
On-line CPU(s) list:                0-3
Vendor ID:                          AuthenticAMD
Model name:                         AMD EPYC 7763 64-Core Processor
CPU family:                         25
Model:                              1
Thread(s) per core:                 2
Core(s) per socket:                 2
Socket(s):                          1
Stepping:                           1
BogoMIPS:                           4890.86
Flags:                              fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization:                     AMD-V
Hypervisor vendor:                  Microsoft
Virtualization type:                full
L1d cache:                          64 KiB (2 instances)
L1i cache:                          64 KiB (2 instances)
L2 cache:                           1 MiB (2 instances)
L3 cache:                           32 MiB (1 instance)
NUMA node(s):                       1
NUMA node0 CPU(s):                  0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit:        Not affected
Vulnerability L1tf:                 Not affected
Vulnerability Mds:                  Not affected
Vulnerability Meltdown:             Not affected
Vulnerability Mmio stale data:      Not affected
Vulnerability Retbleed:             Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass:    Vulnerable
Vulnerability Spectre v1:           Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:           Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds:                Not affected
Vulnerability Tsx async abort:      Not affected
Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft

@github-actions GitHub Actions
Copy link
Contributor

Benchmark result

Judge result

Benchmark Report for /home/runner/work/ADNLPModels.jl/ADNLPModels.jl

Job Properties

  • Time of benchmarks:
    • Target: 11 Jul 2024 - 20:26
    • Baseline: 11 Jul 2024 - 20:38
  • Package commits:
    • Target: 7133c2
    • Baseline: e89bd3
  • Julia commits:
    • Target: 48d4fd
    • Baseline: 48d4fd
  • Julia command flags:
    • Target: None
    • Baseline: None
  • Environment variables:
    • Target: None
    • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["jac_coord", "optimized", "Float32", "scalable", "sparse", "camshape"] 0.94 (5%) ✅ 1.00 (1%)
["jac_coord", "optimized", "Float32", "scalable", "sparse", "robotarm"] 0.94 (5%) ✅ 1.00 (1%)
["jac_coord", "optimized", "Float64", "scalable", "sparse", "elec"] 0.91 (5%) ✅ 1.00 (1%)
["jac_coord", "optimized", "Float64", "scalable", "sparse", "polygon1"] 1.11 (5%) ❌ 1.00 (1%)
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "arglinb"] 0.93 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "bdqrtic"] 0.94 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "brownal"] 0.94 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "broyden3d"] 0.86 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "dixon3dq"] 0.95 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "freuroth"] 0.92 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "hovercraft1d"] 0.88 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "penalty1"] 0.82 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "power"] 0.87 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "spmsrtls"] 0.92 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "tquartic"] 0.83 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "arglinb"] 1.07 (5%) ❌ 1.00 (1%)
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "bdqrtic"] 0.91 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "brownal"] 0.90 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "broyden3d"] 0.91 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "dixon3dq"] 0.88 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "freuroth"] 0.92 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "hovercraft1d"] 0.92 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "penalty1"] 0.91 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "power"] 0.78 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "spmsrtls"] 0.94 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "tquartic"] 0.88 (5%) ✅ 1.00 (1%)
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "camshape"] 1.06 (5%) ❌ 1.02 (1%) ❌
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "catenary"] 1.03 (5%) 1.03 (1%) ❌
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "chain"] 1.03 (5%) 1.03 (1%) ❌
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "clnlbeam"] 1.06 (5%) ❌ 1.03 (1%) ❌
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "controlinvestment"] 1.02 (5%) 1.05 (1%) ❌
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "elec"] 1.09 (5%) ❌ 1.06 (1%) ❌
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "hovercraft1d"] 1.15 (5%) ❌ 1.08 (1%) ❌
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "marine"] 1.05 (5%) 1.04 (1%) ❌
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "polygon1"] 1.11 (5%) ❌ 1.10 (1%) ❌
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "polygon3"] 1.04 (5%) 1.05 (1%) ❌
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "robotarm"] 1.05 (5%) 1.03 (1%) ❌
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "structural"] 1.02 (5%) 1.02 (1%) ❌
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "channel"] 0.93 (5%) ✅ 1.00 (1%)
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "hovercraft1d"] 1.03 (5%) 1.03 (1%) ❌
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "polygon1"] 0.99 (5%) 1.04 (1%) ❌
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "structural"] 0.99 (5%) 1.01 (1%) ❌

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["jac_coord", "optimized", "Float32", "scalable", "sparse"]
  • ["jac_coord", "optimized", "Float64", "scalable", "sparse"]
  • ["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse"]
  • ["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse"]
  • ["jacobian_backend", "optimized", "Float64", "scalable", "sparse"]
  • ["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics"]

Julia versioninfo

Target

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1023-azure #24~22.04.1-Ubuntu SMP Wed Jun 12 19:55:26 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3214 MHz       7261 s          0 s        361 s      12366 s          0 s
       #2  3243 MHz       8898 s          0 s        339 s      10754 s          0 s
       #3  2445 MHz       6540 s          0 s        371 s      13081 s          0 s
       #4  2445 MHz       6889 s          0 s        350 s      12755 s          0 s
  Memory: 15.606491088867188 GB (13227.78125 MB free)
  Uptime: 2004.27 sec
  Load Avg:  1.05  1.05  1.2
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1023-azure #24~22.04.1-Ubuntu SMP Wed Jun 12 19:55:26 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3251 MHz       9783 s          0 s        424 s      16798 s          0 s
       #2  3243 MHz      10983 s          0 s        404 s      15622 s          0 s
       #3  3241 MHz       7868 s          0 s        451 s      18686 s          0 s
       #4  2445 MHz       8075 s          0 s        420 s      18514 s          0 s
  Memory: 15.606491088867188 GB (13313.0078125 MB free)
  Uptime: 2707.15 sec
  Load Avg:  1.12  1.06  1.11
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/ADNLPModels.jl/ADNLPModels.jl

Job Properties

  • Time of benchmark: 11 Jul 2024 - 20:26
  • Package commit: 7133c2
  • Julia commit: 48d4fd
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["jac_coord", "optimized", "Float32", "scalable", "sparse", "camshape"] 36.829 μs (5%) 32.47 KiB (1%) 10
["jac_coord", "optimized", "Float32", "scalable", "sparse", "catenary"] 21.630 μs (5%) 33.36 KiB (1%) 12
["jac_coord", "optimized", "Float32", "scalable", "sparse", "chain"] 33.744 μs (5%) 39.23 KiB (1%) 12
["jac_coord", "optimized", "Float32", "scalable", "sparse", "channel"] 1.716 ms (5%) 64.09 KiB (1%) 15
["jac_coord", "optimized", "Float32", "scalable", "sparse", "clnlbeam"] 42.099 μs (5%) 27.55 KiB (1%) 10
["jac_coord", "optimized", "Float32", "scalable", "sparse", "controlinvestment"] 88.406 μs (5%) 24.98 KiB (1%) 10
["jac_coord", "optimized", "Float32", "scalable", "sparse", "elec"] 11.281 μs (5%) 16.92 KiB (1%) 9
["jac_coord", "optimized", "Float32", "scalable", "sparse", "hovercraft1d"] 522.209 ns (5%) 7.94 KiB (1%) 1
["jac_coord", "optimized", "Float32", "scalable", "sparse", "marine"] 38.572 μs (5%) 33.86 KiB (1%) 12
["jac_coord", "optimized", "Float32", "scalable", "sparse", "polygon1"] 326.995 ns (5%) 4.06 KiB (1%) 1
["jac_coord", "optimized", "Float32", "scalable", "sparse", "polygon3"] 16.511 μs (5%) 28.92 KiB (1%) 10
["jac_coord", "optimized", "Float32", "scalable", "sparse", "robotarm"] 35.367 μs (5%) 38.61 KiB (1%) 12
["jac_coord", "optimized", "Float32", "scalable", "sparse", "structural"] 2.962 μs (5%) 50.48 KiB (1%) 2
["jac_coord", "optimized", "Float64", "scalable", "sparse", "camshape"] 44.664 μs (5%) 51.97 KiB (1%) 10
["jac_coord", "optimized", "Float64", "scalable", "sparse", "catenary"] 25.858 μs (5%) 41.11 KiB (1%) 12
["jac_coord", "optimized", "Float64", "scalable", "sparse", "chain"] 44.202 μs (5%) 52.78 KiB (1%) 13
["jac_coord", "optimized", "Float64", "scalable", "sparse", "channel"] 2.057 ms (5%) 94.34 KiB (1%) 15
["jac_coord", "optimized", "Float64", "scalable", "sparse", "clnlbeam"] 45.235 μs (5%) 37.84 KiB (1%) 11
["jac_coord", "optimized", "Float64", "scalable", "sparse", "controlinvestment"] 89.848 μs (5%) 32.80 KiB (1%) 10
["jac_coord", "optimized", "Float64", "scalable", "sparse", "elec"] 12.313 μs (5%) 20.80 KiB (1%) 9
["jac_coord", "optimized", "Float64", "scalable", "sparse", "hovercraft1d"] 971.800 ns (5%) 15.75 KiB (1%) 1
["jac_coord", "optimized", "Float64", "scalable", "sparse", "marine"] 42.570 μs (5%) 42.03 KiB (1%) 13
["jac_coord", "optimized", "Float64", "scalable", "sparse", "polygon1"] 535.842 ns (5%) 7.94 KiB (1%) 1
["jac_coord", "optimized", "Float64", "scalable", "sparse", "polygon3"] 20.268 μs (5%) 40.53 KiB (1%) 11
["jac_coord", "optimized", "Float64", "scalable", "sparse", "robotarm"] 38.241 μs (5%) 51.53 KiB (1%) 13
["jac_coord", "optimized", "Float64", "scalable", "sparse", "structural"] 5.605 μs (5%) 100.86 KiB (1%) 2
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "arglina"] 35.501 ms (5%) 11.72 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "arglinb"] 6.091 ms (5%) 11.72 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "bdqrtic"] 32.100 μs (5%) 44.52 KiB (1%) 9
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "brownal"] 7.957 ms (5%) 7.90 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "broyden3d"] 11.903 μs (5%) 24.59 KiB (1%) 6
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "brybnd"] 123.652 μs (5%) 56.83 KiB (1%) 11
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "dixon3dq"] 7.727 μs (5%) 16.47 KiB (1%) 5
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "errinros_mod"] 30.738 μs (5%) 20.41 KiB (1%) 5
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "freuroth"] 15.028 μs (5%) 24.28 KiB (1%) 5
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "hovercraft1d"] 3.761 μs (5%) 5.80 KiB (1%) 4
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "integreq"] 37.753 s (5%) 7.90 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "morebv"] 191.368 μs (5%) 24.59 KiB (1%) 6
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "penalty1"] 3.042 ms (5%) 4.10 MiB (1%) 1003
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "power"] 2.739 ms (5%) 4.09 MiB (1%) 1003
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "sbrybnd"] 144.781 μs (5%) 56.83 KiB (1%) 11
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "spmsrtls"] 29.395 μs (5%) 36.45 KiB (1%) 8
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "tquartic"] 8.052 μs (5%) 16.47 KiB (1%) 5
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "arglina"] 36.101 ms (5%) 19.35 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "arglinb"] 7.975 ms (5%) 1.007 ms 19.35 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "bdqrtic"] 35.055 μs (5%) 67.83 KiB (1%) 9
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "brownal"] 6.365 ms (5%) 11.72 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "broyden3d"] 14.708 μs (5%) 36.20 KiB (1%) 7
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "brybnd"] 145.554 μs (5%) 84.08 KiB (1%) 11
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "dixon3dq"] 8.372 μs (5%) 24.28 KiB (1%) 5
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "errinros_mod"] 35.968 μs (5%) 32.02 KiB (1%) 6
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "freuroth"] 16.190 μs (5%) 39.83 KiB (1%) 6
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "hovercraft1d"] 3.932 μs (5%) 7.09 KiB (1%) 4
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "integreq"] 41.494 s (5%) 11.72 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "morebv"] 193.322 μs (5%) 36.20 KiB (1%) 7
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "penalty1"] 3.657 ms (5%) 4.10 MiB (1%) 1003
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "power"] 2.738 ms (5%) 4.10 MiB (1%) 1003
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "sbrybnd"] 141.476 μs (5%) 84.08 KiB (1%) 11
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "spmsrtls"] 31.649 μs (5%) 55.95 KiB (1%) 8
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "tquartic"] 9.518 μs (5%) 24.28 KiB (1%) 5
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "camshape"] 842.578 μs (5%) 1.82 MiB (1%) 15297
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "catenary"] 434.875 μs (5%) 842.50 KiB (1%) 6892
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "chain"] 553.216 μs (5%) 1.38 MiB (1%) 8642
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "channel"] 2.705 ms (5%) 4.20 MiB (1%) 48965
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "clnlbeam"] 316.553 μs (5%) 817.39 KiB (1%) 5628
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "controlinvestment"] 496.479 μs (5%) 1.29 MiB (1%) 10287
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "elec"] 278.140 μs (5%) 773.41 KiB (1%) 5603
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "hovercraft1d"] 171.261 μs (5%) 561.94 KiB (1%) 3278
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "marine"] 711.682 μs (5%) 1.17 MiB (1%) 11806
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "polygon1"] 155.221 μs (5%) 487.80 KiB (1%) 3259
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "polygon3"] 495.348 μs (5%) 1.21 MiB (1%) 9296
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "robotarm"] 566.822 μs (5%) 1.28 MiB (1%) 9963
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "structural"] 1.522 ms (5%) 6.96 MiB (1%) 14838
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "camshape"] 83.825 ms (5%) 45.75 MiB (1%) 748990
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "catenary"] 32.841 ms (5%) 17.07 MiB (1%) 272384
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "chain"] 52.876 ms (5%) 24.44 MiB (1%) 401898
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "channel"] 265.128 ms (5%) 14.228 ms 137.61 MiB (1%) 2309946
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "clnlbeam"] 21.079 ms (5%) 10.69 MiB (1%) 168628
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "controlinvestment"] 33.342 ms (5%) 18.37 MiB (1%) 299430
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "elec"] 12.698 ms (5%) 7.58 MiB (1%) 123505
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "hovercraft1d"] 1.542 ms (5%) 1.28 MiB (1%) 18767
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "marine"] 20.644 ms (5%) 11.89 MiB (1%) 191017
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "polygon1"] 1.547 ms (5%) 1.21 MiB (1%) 18780
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "polygon3"] 31.493 ms (5%) 16.90 MiB (1%) 284273
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "robotarm"] 45.972 ms (5%) 24.45 MiB (1%) 396798
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "structural"] 6.568 ms (5%) 9.63 MiB (1%) 70999

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["jac_coord", "optimized", "Float32", "scalable", "sparse"]
  • ["jac_coord", "optimized", "Float64", "scalable", "sparse"]
  • ["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse"]
  • ["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse"]
  • ["jacobian_backend", "optimized", "Float64", "scalable", "sparse"]
  • ["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics"]

Julia versioninfo

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1023-azure #24~22.04.1-Ubuntu SMP Wed Jun 12 19:55:26 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3214 MHz       7261 s          0 s        361 s      12366 s          0 s
       #2  3243 MHz       8898 s          0 s        339 s      10754 s          0 s
       #3  2445 MHz       6540 s          0 s        371 s      13081 s          0 s
       #4  2445 MHz       6889 s          0 s        350 s      12755 s          0 s
  Memory: 15.606491088867188 GB (13227.78125 MB free)
  Uptime: 2004.27 sec
  Load Avg:  1.05  1.05  1.2
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/ADNLPModels.jl/ADNLPModels.jl

Job Properties

  • Time of benchmark: 11 Jul 2024 - 20:38
  • Package commit: e89bd3
  • Julia commit: 48d4fd
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["jac_coord", "optimized", "Float32", "scalable", "sparse", "camshape"] 39.374 μs (5%) 32.47 KiB (1%) 10
["jac_coord", "optimized", "Float32", "scalable", "sparse", "catenary"] 22.372 μs (5%) 33.36 KiB (1%) 12
["jac_coord", "optimized", "Float32", "scalable", "sparse", "chain"] 35.266 μs (5%) 39.23 KiB (1%) 12
["jac_coord", "optimized", "Float32", "scalable", "sparse", "channel"] 1.720 ms (5%) 64.09 KiB (1%) 15
["jac_coord", "optimized", "Float32", "scalable", "sparse", "clnlbeam"] 43.422 μs (5%) 27.55 KiB (1%) 10
["jac_coord", "optimized", "Float32", "scalable", "sparse", "controlinvestment"] 89.547 μs (5%) 24.98 KiB (1%) 10
["jac_coord", "optimized", "Float32", "scalable", "sparse", "elec"] 11.812 μs (5%) 16.92 KiB (1%) 9
["jac_coord", "optimized", "Float32", "scalable", "sparse", "hovercraft1d"] 529.813 ns (5%) 7.94 KiB (1%) 1
["jac_coord", "optimized", "Float32", "scalable", "sparse", "marine"] 39.093 μs (5%) 33.86 KiB (1%) 12
["jac_coord", "optimized", "Float32", "scalable", "sparse", "polygon1"] 321.890 ns (5%) 4.06 KiB (1%) 1
["jac_coord", "optimized", "Float32", "scalable", "sparse", "polygon3"] 17.282 μs (5%) 28.92 KiB (1%) 10
["jac_coord", "optimized", "Float32", "scalable", "sparse", "robotarm"] 37.480 μs (5%) 38.61 KiB (1%) 12
["jac_coord", "optimized", "Float32", "scalable", "sparse", "structural"] 2.973 μs (5%) 50.48 KiB (1%) 2
["jac_coord", "optimized", "Float64", "scalable", "sparse", "camshape"] 45.906 μs (5%) 51.97 KiB (1%) 10
["jac_coord", "optimized", "Float64", "scalable", "sparse", "catenary"] 25.989 μs (5%) 41.11 KiB (1%) 12
["jac_coord", "optimized", "Float64", "scalable", "sparse", "chain"] 46.357 μs (5%) 52.78 KiB (1%) 13
["jac_coord", "optimized", "Float64", "scalable", "sparse", "channel"] 2.066 ms (5%) 94.34 KiB (1%) 15
["jac_coord", "optimized", "Float64", "scalable", "sparse", "clnlbeam"] 46.256 μs (5%) 37.84 KiB (1%) 11
["jac_coord", "optimized", "Float64", "scalable", "sparse", "controlinvestment"] 91.161 μs (5%) 32.80 KiB (1%) 10
["jac_coord", "optimized", "Float64", "scalable", "sparse", "elec"] 13.495 μs (5%) 20.80 KiB (1%) 9
["jac_coord", "optimized", "Float64", "scalable", "sparse", "hovercraft1d"] 973.900 ns (5%) 15.75 KiB (1%) 1
["jac_coord", "optimized", "Float64", "scalable", "sparse", "marine"] 43.401 μs (5%) 42.03 KiB (1%) 13
["jac_coord", "optimized", "Float64", "scalable", "sparse", "polygon1"] 483.462 ns (5%) 7.94 KiB (1%) 1
["jac_coord", "optimized", "Float64", "scalable", "sparse", "polygon3"] 20.668 μs (5%) 40.53 KiB (1%) 11
["jac_coord", "optimized", "Float64", "scalable", "sparse", "robotarm"] 40.195 μs (5%) 51.53 KiB (1%) 13
["jac_coord", "optimized", "Float64", "scalable", "sparse", "structural"] 5.584 μs (5%) 100.86 KiB (1%) 2
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "arglina"] 37.128 ms (5%) 11.72 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "arglinb"] 6.520 ms (5%) 11.72 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "bdqrtic"] 34.174 μs (5%) 44.52 KiB (1%) 9
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "brownal"] 8.484 ms (5%) 7.90 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "broyden3d"] 13.886 μs (5%) 24.59 KiB (1%) 6
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "brybnd"] 127.579 μs (5%) 56.83 KiB (1%) 11
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "dixon3dq"] 8.150 μs (5%) 16.47 KiB (1%) 5
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "errinros_mod"] 32.291 μs (5%) 20.41 KiB (1%) 5
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "freuroth"] 16.381 μs (5%) 24.28 KiB (1%) 5
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "hovercraft1d"] 4.252 μs (5%) 5.80 KiB (1%) 4
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "integreq"] 37.780 s (5%) 7.90 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "morebv"] 192.481 μs (5%) 24.59 KiB (1%) 6
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "penalty1"] 3.697 ms (5%) 4.10 MiB (1%) 1003
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "power"] 3.164 ms (5%) 4.09 MiB (1%) 1003
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "sbrybnd"] 149.871 μs (5%) 56.83 KiB (1%) 11
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "spmsrtls"] 31.880 μs (5%) 36.45 KiB (1%) 8
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "tquartic"] 9.668 μs (5%) 16.47 KiB (1%) 5
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "arglina"] 36.309 ms (5%) 19.35 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "arglinb"] 7.469 ms (5%) 19.35 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "bdqrtic"] 38.602 μs (5%) 67.83 KiB (1%) 9
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "brownal"] 7.105 ms (5%) 11.72 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "broyden3d"] 16.170 μs (5%) 36.20 KiB (1%) 7
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "brybnd"] 149.059 μs (5%) 84.08 KiB (1%) 11
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "dixon3dq"] 9.461 μs (5%) 24.28 KiB (1%) 5
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "errinros_mod"] 37.440 μs (5%) 32.02 KiB (1%) 6
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "freuroth"] 17.662 μs (5%) 39.83 KiB (1%) 6
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "hovercraft1d"] 4.282 μs (5%) 7.09 KiB (1%) 4
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "integreq"] 41.482 s (5%) 11.72 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "morebv"] 194.625 μs (5%) 36.20 KiB (1%) 7
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "penalty1"] 3.999 ms (5%) 4.10 MiB (1%) 1003
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "power"] 3.498 ms (5%) 4.10 MiB (1%) 1003
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "sbrybnd"] 146.575 μs (5%) 84.08 KiB (1%) 11
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "spmsrtls"] 33.714 μs (5%) 55.95 KiB (1%) 8
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "tquartic"] 10.791 μs (5%) 24.28 KiB (1%) 5
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "camshape"] 791.213 μs (5%) 1.78 MiB (1%) 15278
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "catenary"] 421.519 μs (5%) 819.95 KiB (1%) 6864
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "chain"] 536.766 μs (5%) 1.34 MiB (1%) 8612
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "channel"] 2.593 ms (5%) 4.17 MiB (1%) 48929
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "clnlbeam"] 298.440 μs (5%) 791.06 KiB (1%) 5607
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "controlinvestment"] 485.339 μs (5%) 1.23 MiB (1%) 10263
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "elec"] 256.039 μs (5%) 728.51 KiB (1%) 5584
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "hovercraft1d"] 149.470 μs (5%) 518.12 KiB (1%) 3268
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "marine"] 679.824 μs (5%) 1.13 MiB (1%) 11776
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "polygon1"] 139.321 μs (5%) 443.98 KiB (1%) 3249
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "polygon3"] 475.231 μs (5%) 1.15 MiB (1%) 9272
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "robotarm"] 541.214 μs (5%) 1.24 MiB (1%) 9935
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "structural"] 1.491 ms (5%) 6.86 MiB (1%) 14827
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "camshape"] 85.977 ms (5%) 45.70 MiB (1%) 748971
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "catenary"] 32.263 ms (5%) 17.05 MiB (1%) 272356
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "chain"] 52.459 ms (5%) 24.40 MiB (1%) 401868
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "channel"] 283.772 ms (5%) 30.497 ms 137.58 MiB (1%) 2309910
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "clnlbeam"] 20.795 ms (5%) 10.61 MiB (1%) 167611
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "controlinvestment"] 33.610 ms (5%) 18.31 MiB (1%) 299406
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "elec"] 12.580 ms (5%) 7.53 MiB (1%) 123486
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "hovercraft1d"] 1.503 ms (5%) 1.24 MiB (1%) 18757
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "marine"] 20.897 ms (5%) 11.85 MiB (1%) 190987
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "polygon1"] 1.556 ms (5%) 1.17 MiB (1%) 18770
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "polygon3"] 31.476 ms (5%) 16.84 MiB (1%) 284249
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "robotarm"] 46.334 ms (5%) 24.41 MiB (1%) 396770
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "structural"] 6.633 ms (5%) 9.53 MiB (1%) 70988

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["jac_coord", "optimized", "Float32", "scalable", "sparse"]
  • ["jac_coord", "optimized", "Float64", "scalable", "sparse"]
  • ["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse"]
  • ["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse"]
  • ["jacobian_backend", "optimized", "Float64", "scalable", "sparse"]
  • ["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics"]

Julia versioninfo

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1023-azure #24~22.04.1-Ubuntu SMP Wed Jun 12 19:55:26 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3251 MHz       9783 s          0 s        424 s      16798 s          0 s
       #2  3243 MHz      10983 s          0 s        404 s      15622 s          0 s
       #3  3241 MHz       7868 s          0 s        451 s      18686 s          0 s
       #4  2445 MHz       8075 s          0 s        420 s      18514 s          0 s
  Memory: 15.606491088867188 GB (13313.0078125 MB free)
  Uptime: 2707.15 sec
  Load Avg:  1.12  1.06  1.11
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture:                       x86_64
CPU op-mode(s):                     32-bit, 64-bit
Address sizes:                      48 bits physical, 48 bits virtual
Byte Order:                         Little Endian
CPU(s):                             4
On-line CPU(s) list:                0-3
Vendor ID:                          AuthenticAMD
Model name:                         AMD EPYC 7763 64-Core Processor
CPU family:                         25
Model:                              1
Thread(s) per core:                 2
Core(s) per socket:                 2
Socket(s):                          1
Stepping:                           1
BogoMIPS:                           4890.86
Flags:                              fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization:                     AMD-V
Hypervisor vendor:                  Microsoft
Virtualization type:                full
L1d cache:                          64 KiB (2 instances)
L1i cache:                          64 KiB (2 instances)
L2 cache:                           1 MiB (2 instances)
L3 cache:                           32 MiB (1 instance)
NUMA node(s):                       1
NUMA node0 CPU(s):                  0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit:        Not affected
Vulnerability L1tf:                 Not affected
Vulnerability Mds:                  Not affected
Vulnerability Meltdown:             Not affected
Vulnerability Mmio stale data:      Not affected
Vulnerability Retbleed:             Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass:    Vulnerable
Vulnerability Spectre v1:           Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:           Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds:                Not affected
Vulnerability Tsx async abort:      Not affected
Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft

@github-actions GitHub Actions
Copy link
Contributor

Benchmark result

Judge result

Benchmark Report for /home/runner/work/ADNLPModels.jl/ADNLPModels.jl

Job Properties

  • Time of benchmarks:
    • Target: 11 Jul 2024 - 20:26
    • Baseline: 11 Jul 2024 - 20:38
  • Package commits:
    • Target: 7133c2
    • Baseline: e89bd3
  • Julia commits:
    • Target: 48d4fd
    • Baseline: 48d4fd
  • Julia command flags:
    • Target: None
    • Baseline: None
  • Environment variables:
    • Target: None
    • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["jac_coord", "optimized", "Float32", "scalable", "sparse", "hovercraft1d"] 0.93 (5%) ✅ 1.00 (1%)
["jac_coord", "optimized", "Float32", "scalable", "sparse", "polygon1"] 1.09 (5%) ❌ 1.00 (1%)
["jac_coord", "optimized", "Float32", "scalable", "sparse", "robotarm"] 0.95 (5%) ✅ 1.00 (1%)
["jac_coord", "optimized", "Float32", "scalable", "sparse", "structural"] 1.13 (5%) ❌ 1.00 (1%)
["jac_coord", "optimized", "Float64", "scalable", "sparse", "chain"] 0.94 (5%) ✅ 1.00 (1%)
["jac_coord", "optimized", "Float64", "scalable", "sparse", "hovercraft1d"] 1.12 (5%) ❌ 1.00 (1%)
["jac_coord", "optimized", "Float64", "scalable", "sparse", "polygon1"] 1.14 (5%) ❌ 1.00 (1%)
["jac_coord", "optimized", "Float64", "scalable", "sparse", "structural"] 1.28 (5%) ❌ 1.00 (1%)
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "bdqrtic"] 0.94 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "broyden3d"] 0.93 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "dixon3dq"] 0.90 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "freuroth"] 0.94 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "hovercraft1d"] 0.89 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "penalty1"] 0.91 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "power"] 0.93 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "spmsrtls"] 0.93 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "tquartic"] 0.87 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "arglinb"] 0.95 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "bdqrtic"] 0.93 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "broyden3d"] 0.90 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "dixon3dq"] 0.91 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "freuroth"] 0.94 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "hovercraft1d"] 0.91 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "penalty1"] 0.88 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "power"] 0.91 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "spmsrtls"] 0.95 (5%) ✅ 1.00 (1%)
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "tquartic"] 0.85 (5%) ✅ 1.00 (1%)
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "camshape"] 1.03 (5%) 1.02 (1%) ❌
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "catenary"] 1.07 (5%) ❌ 1.03 (1%) ❌
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "chain"] 1.03 (5%) 1.03 (1%) ❌
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "clnlbeam"] 1.06 (5%) ❌ 1.03 (1%) ❌
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "controlinvestment"] 1.04 (5%) 1.05 (1%) ❌
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "elec"] 1.08 (5%) ❌ 1.06 (1%) ❌
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "hovercraft1d"] 1.13 (5%) ❌ 1.08 (1%) ❌
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "marine"] 1.03 (5%) 1.04 (1%) ❌
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "polygon1"] 1.12 (5%) ❌ 1.10 (1%) ❌
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "polygon3"] 1.05 (5%) 1.05 (1%) ❌
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "robotarm"] 1.05 (5%) ❌ 1.03 (1%) ❌
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "structural"] 1.04 (5%) 1.02 (1%) ❌
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "catenary"] 1.02 (5%) 1.01 (1%) ❌
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "channel"] 0.92 (5%) ✅ 1.00 (1%)
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "hovercraft1d"] 1.07 (5%) ❌ 1.03 (1%) ❌
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "polygon1"] 1.08 (5%) ❌ 1.04 (1%) ❌
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "structural"] 1.02 (5%) 1.01 (1%) ❌

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["jac_coord", "optimized", "Float32", "scalable", "sparse"]
  • ["jac_coord", "optimized", "Float64", "scalable", "sparse"]
  • ["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse"]
  • ["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse"]
  • ["jacobian_backend", "optimized", "Float64", "scalable", "sparse"]
  • ["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics"]

Julia versioninfo

Target

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1023-azure #24~22.04.1-Ubuntu SMP Wed Jun 12 19:55:26 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3218 MHz       7855 s          0 s        375 s      12137 s          0 s
       #2  2445 MHz       9178 s          0 s        389 s      10809 s          0 s
       #3  3243 MHz       6752 s          0 s        383 s      13234 s          0 s
       #4  3276 MHz       5841 s          0 s        392 s      14129 s          0 s
  Memory: 15.606491088867188 GB (13274.05859375 MB free)
  Uptime: 2042.97 sec
  Load Avg:  1.06  1.08  1.22
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1023-azure #24~22.04.1-Ubuntu SMP Wed Jun 12 19:55:26 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2515 MHz       9940 s          0 s        448 s      17022 s          0 s
       #2  3192 MHz      10856 s          0 s        464 s      16098 s          0 s
       #3  2445 MHz       8523 s          0 s        454 s      18434 s          0 s
       #4  3243 MHz       7453 s          0 s        488 s      19463 s          0 s
  Memory: 15.606491088867188 GB (13238.69921875 MB free)
  Uptime: 2748.62 sec
  Load Avg:  1.06  1.04  1.1
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/ADNLPModels.jl/ADNLPModels.jl

Job Properties

  • Time of benchmark: 11 Jul 2024 - 20:26
  • Package commit: 7133c2
  • Julia commit: 48d4fd
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["jac_coord", "optimized", "Float32", "scalable", "sparse", "camshape"] 37.209 μs (5%) 32.47 KiB (1%) 10
["jac_coord", "optimized", "Float32", "scalable", "sparse", "catenary"] 21.360 μs (5%) 33.36 KiB (1%) 12
["jac_coord", "optimized", "Float32", "scalable", "sparse", "chain"] 34.745 μs (5%) 39.23 KiB (1%) 12
["jac_coord", "optimized", "Float32", "scalable", "sparse", "channel"] 1.725 ms (5%) 64.09 KiB (1%) 15
["jac_coord", "optimized", "Float32", "scalable", "sparse", "clnlbeam"] 42.038 μs (5%) 27.55 KiB (1%) 10
["jac_coord", "optimized", "Float32", "scalable", "sparse", "controlinvestment"] 88.204 μs (5%) 24.98 KiB (1%) 10
["jac_coord", "optimized", "Float32", "scalable", "sparse", "elec"] 11.341 μs (5%) 16.92 KiB (1%) 9
["jac_coord", "optimized", "Float32", "scalable", "sparse", "hovercraft1d"] 476.516 ns (5%) 7.94 KiB (1%) 1
["jac_coord", "optimized", "Float32", "scalable", "sparse", "marine"] 38.642 μs (5%) 33.86 KiB (1%) 12
["jac_coord", "optimized", "Float32", "scalable", "sparse", "polygon1"] 332.905 ns (5%) 4.06 KiB (1%) 1
["jac_coord", "optimized", "Float32", "scalable", "sparse", "polygon3"] 17.192 μs (5%) 28.92 KiB (1%) 10
["jac_coord", "optimized", "Float32", "scalable", "sparse", "robotarm"] 35.496 μs (5%) 38.61 KiB (1%) 12
["jac_coord", "optimized", "Float32", "scalable", "sparse", "structural"] 3.430 μs (5%) 50.48 KiB (1%) 2
["jac_coord", "optimized", "Float64", "scalable", "sparse", "camshape"] 45.034 μs (5%) 51.97 KiB (1%) 10
["jac_coord", "optimized", "Float64", "scalable", "sparse", "catenary"] 25.427 μs (5%) 41.11 KiB (1%) 12
["jac_coord", "optimized", "Float64", "scalable", "sparse", "chain"] 44.343 μs (5%) 52.78 KiB (1%) 13
["jac_coord", "optimized", "Float64", "scalable", "sparse", "channel"] 2.062 ms (5%) 94.34 KiB (1%) 15
["jac_coord", "optimized", "Float64", "scalable", "sparse", "clnlbeam"] 45.605 μs (5%) 37.84 KiB (1%) 11
["jac_coord", "optimized", "Float64", "scalable", "sparse", "controlinvestment"] 90.539 μs (5%) 32.80 KiB (1%) 10
["jac_coord", "optimized", "Float64", "scalable", "sparse", "elec"] 12.383 μs (5%) 20.80 KiB (1%) 9
["jac_coord", "optimized", "Float64", "scalable", "sparse", "hovercraft1d"] 1.001 μs (5%) 15.75 KiB (1%) 1
["jac_coord", "optimized", "Float64", "scalable", "sparse", "marine"] 42.219 μs (5%) 42.03 KiB (1%) 13
["jac_coord", "optimized", "Float64", "scalable", "sparse", "polygon1"] 548.618 ns (5%) 7.94 KiB (1%) 1
["jac_coord", "optimized", "Float64", "scalable", "sparse", "polygon3"] 20.258 μs (5%) 40.53 KiB (1%) 11
["jac_coord", "optimized", "Float64", "scalable", "sparse", "robotarm"] 38.532 μs (5%) 51.53 KiB (1%) 13
["jac_coord", "optimized", "Float64", "scalable", "sparse", "structural"] 6.841 μs (5%) 100.86 KiB (1%) 2
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "arglina"] 35.413 ms (5%) 11.72 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "arglinb"] 6.229 ms (5%) 11.72 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "bdqrtic"] 32.701 μs (5%) 44.52 KiB (1%) 9
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "brownal"] 8.133 ms (5%) 7.90 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "broyden3d"] 12.413 μs (5%) 24.59 KiB (1%) 6
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "brybnd"] 124.191 μs (5%) 56.83 KiB (1%) 11
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "dixon3dq"] 7.564 μs (5%) 16.47 KiB (1%) 5
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "errinros_mod"] 30.707 μs (5%) 20.41 KiB (1%) 5
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "freuroth"] 15.279 μs (5%) 24.28 KiB (1%) 5
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "hovercraft1d"] 3.801 μs (5%) 5.80 KiB (1%) 4
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "integreq"] 37.613 s (5%) 7.90 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "morebv"] 189.634 μs (5%) 24.59 KiB (1%) 6
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "penalty1"] 3.071 ms (5%) 4.10 MiB (1%) 1003
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "power"] 2.847 ms (5%) 4.09 MiB (1%) 1003
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "sbrybnd"] 144.199 μs (5%) 56.83 KiB (1%) 11
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "spmsrtls"] 29.766 μs (5%) 36.45 KiB (1%) 8
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "tquartic"] 8.135 μs (5%) 16.47 KiB (1%) 5
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "arglina"] 37.527 ms (5%) 1.140 ms 19.35 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "arglinb"] 8.544 ms (5%) 1.150 ms 19.35 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "bdqrtic"] 35.125 μs (5%) 67.83 KiB (1%) 9
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "brownal"] 6.774 ms (5%) 11.72 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "broyden3d"] 14.788 μs (5%) 36.20 KiB (1%) 7
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "brybnd"] 145.802 μs (5%) 84.08 KiB (1%) 11
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "dixon3dq"] 8.542 μs (5%) 24.28 KiB (1%) 5
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "errinros_mod"] 36.388 μs (5%) 32.02 KiB (1%) 6
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "freuroth"] 16.310 μs (5%) 39.83 KiB (1%) 6
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "hovercraft1d"] 4.004 μs (5%) 7.09 KiB (1%) 4
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "integreq"] 41.513 s (5%) 11.72 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "morebv"] 194.142 μs (5%) 36.20 KiB (1%) 7
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "penalty1"] 3.900 ms (5%) 4.10 MiB (1%) 1003
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "power"] 2.794 ms (5%) 4.10 MiB (1%) 1003
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "sbrybnd"] 142.305 μs (5%) 84.08 KiB (1%) 11
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "spmsrtls"] 31.959 μs (5%) 55.95 KiB (1%) 8
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "tquartic"] 9.668 μs (5%) 24.28 KiB (1%) 5
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "camshape"] 835.719 μs (5%) 1.82 MiB (1%) 15297
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "catenary"] 459.578 μs (5%) 842.50 KiB (1%) 6892
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "chain"] 560.054 μs (5%) 1.38 MiB (1%) 8642
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "channel"] 2.701 ms (5%) 4.20 MiB (1%) 48965
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "clnlbeam"] 318.324 μs (5%) 817.39 KiB (1%) 5628
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "controlinvestment"] 501.726 μs (5%) 1.29 MiB (1%) 10287
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "elec"] 278.619 μs (5%) 773.41 KiB (1%) 5603
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "hovercraft1d"] 172.682 μs (5%) 561.94 KiB (1%) 3278
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "marine"] 713.301 μs (5%) 1.17 MiB (1%) 11806
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "polygon1"] 158.055 μs (5%) 487.80 KiB (1%) 3259
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "polygon3"] 500.534 μs (5%) 1.21 MiB (1%) 9296
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "robotarm"] 575.082 μs (5%) 1.28 MiB (1%) 9963
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "structural"] 1.591 ms (5%) 6.96 MiB (1%) 14838
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "camshape"] 84.094 ms (5%) 45.75 MiB (1%) 748990
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "catenary"] 32.605 ms (5%) 17.07 MiB (1%) 272384
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "chain"] 52.189 ms (5%) 24.44 MiB (1%) 401898
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "channel"] 263.912 ms (5%) 13.768 ms 137.61 MiB (1%) 2309946
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "clnlbeam"] 20.488 ms (5%) 10.69 MiB (1%) 168628
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "controlinvestment"] 32.792 ms (5%) 18.37 MiB (1%) 299430
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "elec"] 12.780 ms (5%) 7.58 MiB (1%) 123505
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "hovercraft1d"] 1.593 ms (5%) 1.28 MiB (1%) 18767
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "marine"] 20.516 ms (5%) 11.89 MiB (1%) 191017
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "polygon1"] 1.579 ms (5%) 1.21 MiB (1%) 18780
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "polygon3"] 31.331 ms (5%) 16.90 MiB (1%) 284273
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "robotarm"] 45.283 ms (5%) 24.45 MiB (1%) 396798
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "structural"] 6.706 ms (5%) 9.63 MiB (1%) 70999

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["jac_coord", "optimized", "Float32", "scalable", "sparse"]
  • ["jac_coord", "optimized", "Float64", "scalable", "sparse"]
  • ["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse"]
  • ["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse"]
  • ["jacobian_backend", "optimized", "Float64", "scalable", "sparse"]
  • ["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics"]

Julia versioninfo

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1023-azure #24~22.04.1-Ubuntu SMP Wed Jun 12 19:55:26 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3218 MHz       7855 s          0 s        375 s      12137 s          0 s
       #2  2445 MHz       9178 s          0 s        389 s      10809 s          0 s
       #3  3243 MHz       6752 s          0 s        383 s      13234 s          0 s
       #4  3276 MHz       5841 s          0 s        392 s      14129 s          0 s
  Memory: 15.606491088867188 GB (13274.05859375 MB free)
  Uptime: 2042.97 sec
  Load Avg:  1.06  1.08  1.22
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/ADNLPModels.jl/ADNLPModels.jl

Job Properties

  • Time of benchmark: 11 Jul 2024 - 20:38
  • Package commit: e89bd3
  • Julia commit: 48d4fd
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["jac_coord", "optimized", "Float32", "scalable", "sparse", "camshape"] 38.212 μs (5%) 32.47 KiB (1%) 10
["jac_coord", "optimized", "Float32", "scalable", "sparse", "catenary"] 21.921 μs (5%) 33.36 KiB (1%) 12
["jac_coord", "optimized", "Float32", "scalable", "sparse", "chain"] 35.265 μs (5%) 39.23 KiB (1%) 12
["jac_coord", "optimized", "Float32", "scalable", "sparse", "channel"] 1.726 ms (5%) 64.09 KiB (1%) 15
["jac_coord", "optimized", "Float32", "scalable", "sparse", "clnlbeam"] 43.251 μs (5%) 27.55 KiB (1%) 10
["jac_coord", "optimized", "Float32", "scalable", "sparse", "controlinvestment"] 89.897 μs (5%) 24.98 KiB (1%) 10
["jac_coord", "optimized", "Float32", "scalable", "sparse", "elec"] 11.672 μs (5%) 16.92 KiB (1%) 9
["jac_coord", "optimized", "Float32", "scalable", "sparse", "hovercraft1d"] 511.474 ns (5%) 7.94 KiB (1%) 1
["jac_coord", "optimized", "Float32", "scalable", "sparse", "marine"] 39.995 μs (5%) 33.86 KiB (1%) 12
["jac_coord", "optimized", "Float32", "scalable", "sparse", "polygon1"] 305.281 ns (5%) 4.06 KiB (1%) 1
["jac_coord", "optimized", "Float32", "scalable", "sparse", "polygon3"] 17.162 μs (5%) 28.92 KiB (1%) 10
["jac_coord", "optimized", "Float32", "scalable", "sparse", "robotarm"] 37.480 μs (5%) 38.61 KiB (1%) 12
["jac_coord", "optimized", "Float32", "scalable", "sparse", "structural"] 3.031 μs (5%) 50.48 KiB (1%) 2
["jac_coord", "optimized", "Float64", "scalable", "sparse", "camshape"] 46.217 μs (5%) 51.97 KiB (1%) 10
["jac_coord", "optimized", "Float64", "scalable", "sparse", "catenary"] 26.640 μs (5%) 41.11 KiB (1%) 12
["jac_coord", "optimized", "Float64", "scalable", "sparse", "chain"] 47.248 μs (5%) 52.78 KiB (1%) 13
["jac_coord", "optimized", "Float64", "scalable", "sparse", "channel"] 2.064 ms (5%) 94.34 KiB (1%) 15
["jac_coord", "optimized", "Float64", "scalable", "sparse", "clnlbeam"] 46.777 μs (5%) 37.84 KiB (1%) 11
["jac_coord", "optimized", "Float64", "scalable", "sparse", "controlinvestment"] 91.320 μs (5%) 32.80 KiB (1%) 10
["jac_coord", "optimized", "Float64", "scalable", "sparse", "elec"] 12.724 μs (5%) 20.80 KiB (1%) 9
["jac_coord", "optimized", "Float64", "scalable", "sparse", "hovercraft1d"] 896.049 ns (5%) 15.75 KiB (1%) 1
["jac_coord", "optimized", "Float64", "scalable", "sparse", "marine"] 43.080 μs (5%) 42.03 KiB (1%) 13
["jac_coord", "optimized", "Float64", "scalable", "sparse", "polygon1"] 483.204 ns (5%) 7.94 KiB (1%) 1
["jac_coord", "optimized", "Float64", "scalable", "sparse", "polygon3"] 20.709 μs (5%) 40.53 KiB (1%) 11
["jac_coord", "optimized", "Float64", "scalable", "sparse", "robotarm"] 39.824 μs (5%) 51.53 KiB (1%) 13
["jac_coord", "optimized", "Float64", "scalable", "sparse", "structural"] 5.362 μs (5%) 100.86 KiB (1%) 2
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "arglina"] 36.884 ms (5%) 11.72 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "arglinb"] 6.481 ms (5%) 11.72 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "bdqrtic"] 34.635 μs (5%) 44.52 KiB (1%) 9
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "brownal"] 8.241 ms (5%) 7.90 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "broyden3d"] 13.295 μs (5%) 24.59 KiB (1%) 6
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "brybnd"] 127.569 μs (5%) 56.83 KiB (1%) 11
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "dixon3dq"] 8.446 μs (5%) 16.47 KiB (1%) 5
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "errinros_mod"] 32.070 μs (5%) 20.41 KiB (1%) 5
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "freuroth"] 16.290 μs (5%) 24.28 KiB (1%) 5
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "hovercraft1d"] 4.268 μs (5%) 5.80 KiB (1%) 4
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "integreq"] 37.717 s (5%) 7.90 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "morebv"] 191.498 μs (5%) 24.59 KiB (1%) 6
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "penalty1"] 3.392 ms (5%) 4.10 MiB (1%) 1003
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "power"] 3.073 ms (5%) 4.09 MiB (1%) 1003
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "sbrybnd"] 149.008 μs (5%) 56.83 KiB (1%) 11
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "spmsrtls"] 32.039 μs (5%) 36.45 KiB (1%) 8
["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse", "tquartic"] 9.378 μs (5%) 16.47 KiB (1%) 5
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "arglina"] 36.786 ms (5%) 19.35 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "arglinb"] 9.035 ms (5%) 19.35 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "bdqrtic"] 37.850 μs (5%) 67.83 KiB (1%) 9
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "brownal"] 6.712 ms (5%) 11.72 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "broyden3d"] 16.500 μs (5%) 36.20 KiB (1%) 7
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "brybnd"] 148.437 μs (5%) 84.08 KiB (1%) 11
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "dixon3dq"] 9.341 μs (5%) 24.28 KiB (1%) 5
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "errinros_mod"] 37.330 μs (5%) 32.02 KiB (1%) 6
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "freuroth"] 17.393 μs (5%) 39.83 KiB (1%) 6
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "hovercraft1d"] 4.421 μs (5%) 7.09 KiB (1%) 4
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "integreq"] 41.472 s (5%) 11.72 MiB (1%) 1004
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "morebv"] 195.164 μs (5%) 36.20 KiB (1%) 7
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "penalty1"] 4.436 ms (5%) 4.10 MiB (1%) 1003
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "power"] 3.060 ms (5%) 4.10 MiB (1%) 1003
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "sbrybnd"] 147.555 μs (5%) 84.08 KiB (1%) 11
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "spmsrtls"] 33.663 μs (5%) 55.95 KiB (1%) 8
["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "tquartic"] 11.321 μs (5%) 24.28 KiB (1%) 5
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "camshape"] 809.819 μs (5%) 1.78 MiB (1%) 15278
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "catenary"] 428.440 μs (5%) 819.95 KiB (1%) 6864
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "chain"] 542.754 μs (5%) 1.34 MiB (1%) 8612
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "channel"] 2.678 ms (5%) 4.17 MiB (1%) 48929
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "clnlbeam"] 299.179 μs (5%) 791.06 KiB (1%) 5607
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "controlinvestment"] 484.744 μs (5%) 1.23 MiB (1%) 10263
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "elec"] 258.553 μs (5%) 728.51 KiB (1%) 5584
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "hovercraft1d"] 152.193 μs (5%) 518.12 KiB (1%) 3268
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "marine"] 694.116 μs (5%) 1.13 MiB (1%) 11776
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "polygon1"] 140.733 μs (5%) 443.98 KiB (1%) 3249
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "polygon3"] 478.202 μs (5%) 1.15 MiB (1%) 9272
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "robotarm"] 546.450 μs (5%) 1.24 MiB (1%) 9935
["jacobian_backend", "optimized", "Float64", "scalable", "sparse", "structural"] 1.529 ms (5%) 6.86 MiB (1%) 14827
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "camshape"] 84.253 ms (5%) 45.70 MiB (1%) 748971
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "catenary"] 32.115 ms (5%) 16.87 MiB (1%) 269368
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "chain"] 52.042 ms (5%) 24.31 MiB (1%) 400374
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "channel"] 287.872 ms (5%) 33.652 ms 137.58 MiB (1%) 2309910
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "clnlbeam"] 20.554 ms (5%) 10.61 MiB (1%) 167611
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "controlinvestment"] 32.743 ms (5%) 18.31 MiB (1%) 299406
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "elec"] 12.756 ms (5%) 7.53 MiB (1%) 123486
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "hovercraft1d"] 1.485 ms (5%) 1.24 MiB (1%) 18757
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "marine"] 20.749 ms (5%) 11.85 MiB (1%) 190987
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "polygon1"] 1.458 ms (5%) 1.17 MiB (1%) 18770
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "polygon3"] 31.606 ms (5%) 16.84 MiB (1%) 284249
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "robotarm"] 45.762 ms (5%) 24.41 MiB (1%) 396770
["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "structural"] 6.596 ms (5%) 9.53 MiB (1%) 70988

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["jac_coord", "optimized", "Float32", "scalable", "sparse"]
  • ["jac_coord", "optimized", "Float64", "scalable", "sparse"]
  • ["jac_coord_residual", "optimized", "Float32", "scalable_nls", "sparse"]
  • ["jac_coord_residual", "optimized", "Float64", "scalable_nls", "sparse"]
  • ["jacobian_backend", "optimized", "Float64", "scalable", "sparse"]
  • ["jacobian_backend", "optimized", "Float64", "scalable", "sparse_symbolics"]

Julia versioninfo

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1023-azure #24~22.04.1-Ubuntu SMP Wed Jun 12 19:55:26 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2515 MHz       9940 s          0 s        448 s      17022 s          0 s
       #2  3192 MHz      10856 s          0 s        464 s      16098 s          0 s
       #3  2445 MHz       8523 s          0 s        454 s      18434 s          0 s
       #4  3243 MHz       7453 s          0 s        488 s      19463 s          0 s
  Memory: 15.606491088867188 GB (13238.69921875 MB free)
  Uptime: 2748.62 sec
  Load Avg:  1.06  1.04  1.1
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture:                       x86_64
CPU op-mode(s):                     32-bit, 64-bit
Address sizes:                      48 bits physical, 48 bits virtual
Byte Order:                         Little Endian
CPU(s):                             4
On-line CPU(s) list:                0-3
Vendor ID:                          AuthenticAMD
Model name:                         AMD EPYC 7763 64-Core Processor
CPU family:                         25
Model:                              1
Thread(s) per core:                 2
Core(s) per socket:                 2
Socket(s):                          1
Stepping:                           1
BogoMIPS:                           4890.85
Flags:                              fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization:                     AMD-V
Hypervisor vendor:                  Microsoft
Virtualization type:                full
L1d cache:                          64 KiB (2 instances)
L1i cache:                          64 KiB (2 instances)
L2 cache:                           1 MiB (2 instances)
L3 cache:                           32 MiB (1 instance)
NUMA node(s):                       1
NUMA node0 CPU(s):                  0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit:        Not affected
Vulnerability L1tf:                 Not affected
Vulnerability Mds:                  Not affected
Vulnerability Meltdown:             Not affected
Vulnerability Mmio stale data:      Not affected
Vulnerability Retbleed:             Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass:    Vulnerable
Vulnerability Spectre v1:           Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:           Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds:                Not affected
Vulnerability Tsx async abort:      Not affected
Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft

@github-actions GitHub Actions
Copy link
Contributor

Benchmark result

Judge result

Benchmark Report for /home/runner/work/ADNLPModels.jl/ADNLPModels.jl

Job Properties

  • Time of benchmarks:
    • Target: 11 Jul 2024 - 21:51
    • Baseline: 11 Jul 2024 - 22:45
  • Package commits:
    • Target: 7133c2
    • Baseline: e89bd3
  • Julia commits:
    • Target: 48d4fd
    • Baseline: 48d4fd
  • Julia command flags:
    • Target: None
    • Baseline: None
  • Environment variables:
    • Target: None
    • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "hovercraft1d"] 0.69 (5%) ✅ 1.00 (1%)
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "integreq"] 1.18 (5%) ❌ 1.00 (1%)
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "power"] 0.94 (5%) ✅ 1.00 (1%)
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "hovercraft1d"] 1.01 (5%) 1.01 (1%) ❌
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "elec"] 1.11 (5%) ❌ 1.00 (1%)
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "hovercraft1d"] 0.85 (5%) ✅ 1.00 (1%)
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "polygon3"] 1.08 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["hess_coord", "optimized", "Float64", "scalable_cons", "sparse"]
  • ["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse"]
  • ["hessian_backend", "optimized", "Float64", "scalable", "sparse"]
  • ["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics"]

Julia versioninfo

Target

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1023-azure #24~22.04.1-Ubuntu SMP Wed Jun 12 19:55:26 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3277 MHz      17982 s          0 s        779 s      52342 s          0 s
       #2  3244 MHz      18886 s          0 s        808 s      51415 s          0 s
       #3  2445 MHz      22458 s          0 s        695 s      47966 s          0 s
       #4  2595 MHz      21225 s          0 s        765 s      49129 s          0 s
  Memory: 15.606491088867188 GB (11662.46875 MB free)
  Uptime: 7123.12 sec
  Load Avg:  1.03  1.03  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1023-azure #24~22.04.1-Ubuntu SMP Wed Jun 12 19:55:26 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3245 MHz      23993 s          0 s        992 s      78098 s          0 s
       #2  3243 MHz      26655 s          0 s       1050 s      75391 s          0 s
       #3  3227 MHz      32705 s          0 s        929 s      69480 s          0 s
       #4  2581 MHz      29220 s          0 s       1034 s      72854 s          0 s
  Memory: 15.606491088867188 GB (12303.4765625 MB free)
  Uptime: 10326.37 sec
  Load Avg:  1.0  1.0  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/ADNLPModels.jl/ADNLPModels.jl

Job Properties

  • Time of benchmark: 11 Jul 2024 - 21:51
  • Package commit: 7133c2
  • Julia commit: 48d4fd
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "camshape"] 405.324 ms (5%) 1.63 MiB (1%) 12350
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "catenary"] 11.208 ms (5%) 369.45 KiB (1%) 2390
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "chain"] 21.562 ms (5%) 283.58 KiB (1%) 1931
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "channel"] 526.444 ms (5%) 1.12 MiB (1%) 7710
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "clnlbeam"] 13.404 ms (5%) 124.95 KiB (1%) 800
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "controlinvestment"] 17.926 ms (5%) 145.08 KiB (1%) 968
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "elec"] 912.906 s (5%) 13.721 ms 232.44 MiB (1%) 1905099
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "hovercraft1d"] 592.327 μs (5%) 5.57 MiB (1%) 386
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "marine"] 404.695 ms (5%) 11.547 ms 193.42 MiB (1%) 1027996
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "polygon1"] 27.751 ms (5%) 334.39 KiB (1%) 1923
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "polygon3"] 96.978 ms (5%) 829.52 KiB (1%) 5873
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "robotarm"] 12.726 s (5%) 132.42 MiB (1%) 981023
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "structural"] 13.862 ms (5%) 96.47 KiB (1%) 854
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "arglina"] 48.762 ms (5%) 332.41 KiB (1%) 2465
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "arglinb"] 41.484 ms (5%) 332.41 KiB (1%) 2465
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "bdqrtic"] 73.304 ms (5%) 339.52 KiB (1%) 2459
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "brownal"] 16.205 s (5%) 5.593 ms 201.87 MiB (1%) 1467003
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "broyden3d"] 24.307 ms (5%) 213.19 KiB (1%) 1469
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "brybnd"] 64.497 ms (5%) 213.19 KiB (1%) 1469
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "dixon3dq"] 8.853 ms (5%) 205.31 KiB (1%) 1469
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "errinros_mod"] 63.557 ms (5%) 340.28 KiB (1%) 2465
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "freuroth"] 74.848 ms (5%) 340.28 KiB (1%) 2465
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "hovercraft1d"] 1.696 ms (5%) 119.56 KiB (1%) 797
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "integreq"] 20.227 s (5%) 213.19 KiB (1%) 1469
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "morebv"] 36.018 ms (5%) 213.19 KiB (1%) 1469
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "penalty1"] 18.607 ms (5%) 213.19 KiB (1%) 1469
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "power"] 2.651 ms (5%) 85.33 KiB (1%) 467
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "sbrybnd"] 70.686 ms (5%) 213.19 KiB (1%) 1469
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "spmsrtls"] 436.209 ms (5%) 2.20 MiB (1%) 16761
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "tquartic"] 11.681 ms (5%) 212.42 KiB (1%) 1463
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "camshape"] 40.072 ms (5%) 87.82 MiB (1%) 111211
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "catenary"] 11.399 ms (5%) 22.47 MiB (1%) 32075
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "chain"] 7.197 ms (5%) 18.17 MiB (1%) 45581
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "channel"] 100.216 ms (5%) 3.118 ms 142.72 MiB (1%) 140799
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "clnlbeam"] 5.308 ms (5%) 13.29 MiB (1%) 42875
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "controlinvestment"] 11.711 ms (5%) 26.58 MiB (1%) 60823
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "elec"] 12.272 s (5%) 210.942 ms 14.97 GiB (1%) 5390328
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "hovercraft1d"] 1.615 ms (5%) 4.05 MiB (1%) 13089
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "marine"] 4.574 ms (5%) 9.94 MiB (1%) 34967
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "polygon1"] 29.803 ms (5%) 50.91 MiB (1%) 35388
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "polygon3"] 34.364 ms (5%) 73.13 MiB (1%) 70969
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "robotarm"] 25.799 ms (5%) 53.71 MiB (1%) 48685
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "structural"] 3.815 ms (5%) 15.03 MiB (1%) 73032
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "camshape"] 538.499 ms (5%) 37.839 ms 323.10 MiB (1%) 1610465
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "catenary"] 112.193 ms (5%) 57.41 MiB (1%) 680094
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "chain"] 139.001 ms (5%) 67.88 MiB (1%) 920495
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "channel"] 709.661 ms (5%) 78.466 ms 283.78 MiB (1%) 3961138
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "clnlbeam"] 137.749 ms (5%) 68.39 MiB (1%) 792406
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "controlinvestment"] 121.009 ms (5%) 71.31 MiB (1%) 807922
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "elec"] 451.336 s (5%) 2.921 s 36.56 GiB (1%) 104916861
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "hovercraft1d"] 11.508 ms (5%) 11.15 MiB (1%) 103101
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "marine"] 90.797 ms (5%) 45.46 MiB (1%) 498175
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "polygon1"] 51.232 ms (5%) 32.93 MiB (1%) 357327
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "polygon3"] 230.404 ms (5%) 10.797 ms 144.98 MiB (1%) 970089
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "robotarm"] 165.012 ms (5%) 101.53 MiB (1%) 841422
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "structural"] 141.490 ms (5%) 3.566 ms 151.56 MiB (1%) 442517

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["hess_coord", "optimized", "Float64", "scalable_cons", "sparse"]
  • ["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse"]
  • ["hessian_backend", "optimized", "Float64", "scalable", "sparse"]
  • ["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics"]

Julia versioninfo

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1023-azure #24~22.04.1-Ubuntu SMP Wed Jun 12 19:55:26 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3277 MHz      17982 s          0 s        779 s      52342 s          0 s
       #2  3244 MHz      18886 s          0 s        808 s      51415 s          0 s
       #3  2445 MHz      22458 s          0 s        695 s      47966 s          0 s
       #4  2595 MHz      21225 s          0 s        765 s      49129 s          0 s
  Memory: 15.606491088867188 GB (11662.46875 MB free)
  Uptime: 7123.12 sec
  Load Avg:  1.03  1.03  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/ADNLPModels.jl/ADNLPModels.jl

Job Properties

  • Time of benchmark: 11 Jul 2024 - 22:45
  • Package commit: e89bd3
  • Julia commit: 48d4fd
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "camshape"] 414.625 ms (5%) 1.63 MiB (1%) 12350
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "catenary"] 11.267 ms (5%) 369.45 KiB (1%) 2390
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "chain"] 21.608 ms (5%) 283.58 KiB (1%) 1931
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "channel"] 524.803 ms (5%) 1.12 MiB (1%) 7710
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "clnlbeam"] 13.590 ms (5%) 124.95 KiB (1%) 800
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "controlinvestment"] 17.929 ms (5%) 145.08 KiB (1%) 968
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "elec"] 915.350 s (5%) 14.453 ms 232.44 MiB (1%) 1905099
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "hovercraft1d"] 862.573 μs (5%) 5.57 MiB (1%) 386
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "marine"] 397.395 ms (5%) 9.025 ms 193.42 MiB (1%) 1027996
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "polygon1"] 27.948 ms (5%) 334.39 KiB (1%) 1923
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "polygon3"] 96.931 ms (5%) 829.52 KiB (1%) 5873
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "robotarm"] 13.007 s (5%) 329.661 ms 132.42 MiB (1%) 981023
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "structural"] 13.899 ms (5%) 96.47 KiB (1%) 854
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "arglina"] 49.004 ms (5%) 332.41 KiB (1%) 2465
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "arglinb"] 41.509 ms (5%) 332.41 KiB (1%) 2465
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "bdqrtic"] 73.392 ms (5%) 339.52 KiB (1%) 2459
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "brownal"] 16.149 s (5%) 15.689 ms 201.87 MiB (1%) 1467003
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "broyden3d"] 24.138 ms (5%) 213.19 KiB (1%) 1469
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "brybnd"] 64.600 ms (5%) 213.19 KiB (1%) 1469
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "dixon3dq"] 8.757 ms (5%) 205.31 KiB (1%) 1469
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "errinros_mod"] 63.174 ms (5%) 340.28 KiB (1%) 2465
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "freuroth"] 74.578 ms (5%) 340.28 KiB (1%) 2465
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "hovercraft1d"] 1.685 ms (5%) 119.56 KiB (1%) 797
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "integreq"] 17.136 s (5%) 213.19 KiB (1%) 1469
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "morebv"] 35.972 ms (5%) 213.19 KiB (1%) 1469
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "penalty1"] 18.623 ms (5%) 213.19 KiB (1%) 1469
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "power"] 2.809 ms (5%) 85.33 KiB (1%) 467
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "sbrybnd"] 71.255 ms (5%) 213.19 KiB (1%) 1469
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "spmsrtls"] 436.885 ms (5%) 2.20 MiB (1%) 16761
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "tquartic"] 11.637 ms (5%) 212.42 KiB (1%) 1463
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "camshape"] 40.458 ms (5%) 87.74 MiB (1%) 111182
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "catenary"] 11.241 ms (5%) 22.42 MiB (1%) 32056
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "chain"] 7.057 ms (5%) 18.11 MiB (1%) 45566
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "channel"] 99.251 ms (5%) 2.996 ms 142.69 MiB (1%) 140763
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "clnlbeam"] 5.286 ms (5%) 13.25 MiB (1%) 42865
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "controlinvestment"] 11.774 ms (5%) 26.53 MiB (1%) 60813
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "elec"] 12.183 s (5%) 182.788 ms 14.97 GiB (1%) 5388323
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "hovercraft1d"] 1.600 ms (5%) 4.01 MiB (1%) 13079
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "marine"] 4.525 ms (5%) 9.90 MiB (1%) 34892
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "polygon1"] 29.746 ms (5%) 50.89 MiB (1%) 35354
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "polygon3"] 34.659 ms (5%) 73.07 MiB (1%) 70945
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "robotarm"] 25.793 ms (5%) 53.47 MiB (1%) 47336
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "structural"] 3.768 ms (5%) 14.92 MiB (1%) 73021
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "camshape"] 546.811 ms (5%) 41.210 ms 323.02 MiB (1%) 1610436
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "catenary"] 110.424 ms (5%) 57.36 MiB (1%) 680075
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "chain"] 136.589 ms (5%) 67.82 MiB (1%) 920480
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "channel"] 707.901 ms (5%) 283.75 MiB (1%) 3961102
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "clnlbeam"] 138.965 ms (5%) 68.29 MiB (1%) 791400
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "controlinvestment"] 122.925 ms (5%) 71.27 MiB (1%) 807912
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "elec"] 405.251 s (5%) 3.692 s 36.56 GiB (1%) 104914856
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "hovercraft1d"] 13.583 ms (5%) 11.10 MiB (1%) 103091
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "marine"] 89.275 ms (5%) 45.43 MiB (1%) 498100
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "polygon1"] 51.273 ms (5%) 32.82 MiB (1%) 355793
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "polygon3"] 213.372 ms (5%) 144.92 MiB (1%) 970065
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "robotarm"] 172.494 ms (5%) 7.201 ms 101.29 MiB (1%) 840073
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "structural"] 143.985 ms (5%) 2.762 ms 151.45 MiB (1%) 442506

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["hess_coord", "optimized", "Float64", "scalable_cons", "sparse"]
  • ["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse"]
  • ["hessian_backend", "optimized", "Float64", "scalable", "sparse"]
  • ["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics"]

Julia versioninfo

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1023-azure #24~22.04.1-Ubuntu SMP Wed Jun 12 19:55:26 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3245 MHz      23993 s          0 s        992 s      78098 s          0 s
       #2  3243 MHz      26655 s          0 s       1050 s      75391 s          0 s
       #3  3227 MHz      32705 s          0 s        929 s      69480 s          0 s
       #4  2581 MHz      29220 s          0 s       1034 s      72854 s          0 s
  Memory: 15.606491088867188 GB (12303.4765625 MB free)
  Uptime: 10326.37 sec
  Load Avg:  1.0  1.0  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture:                       x86_64
CPU op-mode(s):                     32-bit, 64-bit
Address sizes:                      48 bits physical, 48 bits virtual
Byte Order:                         Little Endian
CPU(s):                             4
On-line CPU(s) list:                0-3
Vendor ID:                          AuthenticAMD
Model name:                         AMD EPYC 7763 64-Core Processor
CPU family:                         25
Model:                              1
Thread(s) per core:                 2
Core(s) per socket:                 2
Socket(s):                          1
Stepping:                           1
BogoMIPS:                           4890.85
Flags:                              fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization:                     AMD-V
Hypervisor vendor:                  Microsoft
Virtualization type:                full
L1d cache:                          64 KiB (2 instances)
L1i cache:                          64 KiB (2 instances)
L2 cache:                           1 MiB (2 instances)
L3 cache:                           32 MiB (1 instance)
NUMA node(s):                       1
NUMA node0 CPU(s):                  0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit:        Not affected
Vulnerability L1tf:                 Not affected
Vulnerability Mds:                  Not affected
Vulnerability Meltdown:             Not affected
Vulnerability Mmio stale data:      Not affected
Vulnerability Retbleed:             Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass:    Vulnerable
Vulnerability Spectre v1:           Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:           Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds:                Not affected
Vulnerability Tsx async abort:      Not affected
Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft

@github-actions GitHub Actions
Copy link
Contributor

Benchmark result

Judge result

Benchmark Report for /home/runner/work/ADNLPModels.jl/ADNLPModels.jl

Job Properties

  • Time of benchmarks:
    • Target: 11 Jul 2024 - 21:55
    • Baseline: 11 Jul 2024 - 22:48
  • Package commits:
    • Target: 7133c2
    • Baseline: e89bd3
  • Julia commits:
    • Target: 48d4fd
    • Baseline: 48d4fd
  • Julia command flags:
    • Target: None
    • Baseline: None
  • Environment variables:
    • Target: None
    • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "hovercraft1d"] 0.89 (5%) ✅ 1.00 (1%)
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "broyden3d"] 1.06 (5%) ❌ 1.00 (1%)
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "hovercraft1d"] 1.02 (5%) 1.01 (1%) ❌
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "elec"] 1.07 (5%) ❌ 1.00 (1%)
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "hovercraft1d"] 0.91 (5%) ✅ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["hess_coord", "optimized", "Float64", "scalable_cons", "sparse"]
  • ["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse"]
  • ["hessian_backend", "optimized", "Float64", "scalable", "sparse"]
  • ["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics"]

Julia versioninfo

Target

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1023-azure #24~22.04.1-Ubuntu SMP Wed Jun 12 19:55:26 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3064 MHz      20625 s          0 s        761 s      52561 s          0 s
       #2  2445 MHz      23310 s          0 s        783 s      49870 s          0 s
       #3  3244 MHz      21779 s          0 s        821 s      51340 s          0 s
       #4  3256 MHz      17006 s          0 s        924 s      56017 s          0 s
  Memory: 15.606491088867188 GB (11965.41015625 MB free)
  Uptime: 7408.32 sec
  Load Avg:  1.02  1.03  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1023-azure #24~22.04.1-Ubuntu SMP Wed Jun 12 19:55:26 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3244 MHz      29721 s          0 s       1044 s      75233 s          0 s
       #2  2445 MHz      31295 s          0 s       1093 s      73628 s          0 s
       #3  2593 MHz      30215 s          0 s       1097 s      74683 s          0 s
       #4  2445 MHz      23582 s          0 s       1275 s      81143 s          0 s
  Memory: 15.606491088867188 GB (12823.91796875 MB free)
  Uptime: 10618.24 sec
  Load Avg:  1.05  1.05  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/ADNLPModels.jl/ADNLPModels.jl

Job Properties

  • Time of benchmark: 11 Jul 2024 - 21:55
  • Package commit: 7133c2
  • Julia commit: 48d4fd
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "camshape"] 406.421 ms (5%) 1.63 MiB (1%) 12350
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "catenary"] 11.141 ms (5%) 369.45 KiB (1%) 2390
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "chain"] 21.522 ms (5%) 283.58 KiB (1%) 1931
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "channel"] 521.798 ms (5%) 1.12 MiB (1%) 7710
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "clnlbeam"] 13.945 ms (5%) 124.95 KiB (1%) 800
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "controlinvestment"] 17.922 ms (5%) 145.08 KiB (1%) 968
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "elec"] 912.686 s (5%) 11.048 ms 232.44 MiB (1%) 1905099
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "hovercraft1d"] 584.323 μs (5%) 5.57 MiB (1%) 386
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "marine"] 403.830 ms (5%) 11.193 ms 193.42 MiB (1%) 1027996
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "polygon1"] 27.884 ms (5%) 334.39 KiB (1%) 1923
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "polygon3"] 97.328 ms (5%) 829.52 KiB (1%) 5873
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "robotarm"] 12.767 s (5%) 132.42 MiB (1%) 981023
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "structural"] 13.837 ms (5%) 96.47 KiB (1%) 854
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "arglina"] 49.467 ms (5%) 332.41 KiB (1%) 2465
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "arglinb"] 41.413 ms (5%) 332.41 KiB (1%) 2465
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "bdqrtic"] 73.426 ms (5%) 339.52 KiB (1%) 2459
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "brownal"] 16.353 s (5%) 9.381 ms 201.87 MiB (1%) 1467003
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "broyden3d"] 25.885 ms (5%) 213.19 KiB (1%) 1469
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "brybnd"] 64.551 ms (5%) 213.19 KiB (1%) 1469
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "dixon3dq"] 8.864 ms (5%) 205.31 KiB (1%) 1469
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "errinros_mod"] 64.375 ms (5%) 340.28 KiB (1%) 2465
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "freuroth"] 74.660 ms (5%) 340.28 KiB (1%) 2465
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "hovercraft1d"] 1.686 ms (5%) 119.56 KiB (1%) 797
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "integreq"] 17.198 s (5%) 213.19 KiB (1%) 1469
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "morebv"] 35.934 ms (5%) 213.19 KiB (1%) 1469
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "penalty1"] 18.606 ms (5%) 213.19 KiB (1%) 1469
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "power"] 2.735 ms (5%) 85.33 KiB (1%) 467
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "sbrybnd"] 71.344 ms (5%) 213.19 KiB (1%) 1469
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "spmsrtls"] 435.517 ms (5%) 2.20 MiB (1%) 16761
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "tquartic"] 11.617 ms (5%) 212.42 KiB (1%) 1463
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "camshape"] 40.167 ms (5%) 87.82 MiB (1%) 111211
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "catenary"] 11.223 ms (5%) 22.47 MiB (1%) 32075
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "chain"] 7.062 ms (5%) 18.17 MiB (1%) 45581
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "channel"] 100.357 ms (5%) 2.863 ms 142.72 MiB (1%) 140799
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "clnlbeam"] 5.215 ms (5%) 13.29 MiB (1%) 42875
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "controlinvestment"] 11.734 ms (5%) 26.58 MiB (1%) 60823
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "elec"] 12.299 s (5%) 198.618 ms 14.97 GiB (1%) 5390328
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "hovercraft1d"] 1.595 ms (5%) 4.05 MiB (1%) 13089
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "marine"] 4.519 ms (5%) 9.94 MiB (1%) 34967
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "polygon1"] 29.487 ms (5%) 50.91 MiB (1%) 35388
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "polygon3"] 34.379 ms (5%) 73.13 MiB (1%) 70969
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "robotarm"] 25.665 ms (5%) 53.71 MiB (1%) 48685
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "structural"] 3.874 ms (5%) 15.03 MiB (1%) 73032
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "camshape"] 559.446 ms (5%) 41.131 ms 323.10 MiB (1%) 1610465
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "catenary"] 112.842 ms (5%) 57.41 MiB (1%) 680094
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "chain"] 139.461 ms (5%) 67.88 MiB (1%) 920495
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "channel"] 679.966 ms (5%) 64.051 ms 283.78 MiB (1%) 3961138
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "clnlbeam"] 138.723 ms (5%) 68.39 MiB (1%) 792406
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "controlinvestment"] 125.249 ms (5%) 71.31 MiB (1%) 807922
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "elec"] 456.831 s (5%) 2.728 s 36.56 GiB (1%) 104916861
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "hovercraft1d"] 11.980 ms (5%) 11.15 MiB (1%) 103101
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "marine"] 89.543 ms (5%) 45.46 MiB (1%) 498175
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "polygon1"] 53.155 ms (5%) 32.93 MiB (1%) 357327
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "polygon3"] 224.119 ms (5%) 7.295 ms 144.98 MiB (1%) 970089
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "robotarm"] 163.611 ms (5%) 101.53 MiB (1%) 841422
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "structural"] 145.139 ms (5%) 2.759 ms 151.56 MiB (1%) 442517

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["hess_coord", "optimized", "Float64", "scalable_cons", "sparse"]
  • ["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse"]
  • ["hessian_backend", "optimized", "Float64", "scalable", "sparse"]
  • ["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics"]

Julia versioninfo

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1023-azure #24~22.04.1-Ubuntu SMP Wed Jun 12 19:55:26 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3064 MHz      20625 s          0 s        761 s      52561 s          0 s
       #2  2445 MHz      23310 s          0 s        783 s      49870 s          0 s
       #3  3244 MHz      21779 s          0 s        821 s      51340 s          0 s
       #4  3256 MHz      17006 s          0 s        924 s      56017 s          0 s
  Memory: 15.606491088867188 GB (11965.41015625 MB free)
  Uptime: 7408.32 sec
  Load Avg:  1.02  1.03  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/ADNLPModels.jl/ADNLPModels.jl

Job Properties

  • Time of benchmark: 11 Jul 2024 - 22:48
  • Package commit: e89bd3
  • Julia commit: 48d4fd
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "camshape"] 405.972 ms (5%) 1.63 MiB (1%) 12350
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "catenary"] 11.259 ms (5%) 369.45 KiB (1%) 2390
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "chain"] 21.633 ms (5%) 283.58 KiB (1%) 1931
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "channel"] 522.482 ms (5%) 1.12 MiB (1%) 7710
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "clnlbeam"] 13.499 ms (5%) 124.95 KiB (1%) 800
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "controlinvestment"] 17.962 ms (5%) 145.08 KiB (1%) 968
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "elec"] 912.231 s (5%) 16.135 ms 232.44 MiB (1%) 1905099
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "hovercraft1d"] 654.515 μs (5%) 5.57 MiB (1%) 386
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "marine"] 402.411 ms (5%) 9.699 ms 193.42 MiB (1%) 1027996
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "polygon1"] 27.737 ms (5%) 334.39 KiB (1%) 1923
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "polygon3"] 97.073 ms (5%) 829.52 KiB (1%) 5873
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "robotarm"] 12.723 s (5%) 5.544 ms 132.42 MiB (1%) 981023
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "structural"] 13.859 ms (5%) 96.47 KiB (1%) 854
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "arglina"] 49.390 ms (5%) 332.41 KiB (1%) 2465
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "arglinb"] 42.009 ms (5%) 332.41 KiB (1%) 2465
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "bdqrtic"] 73.655 ms (5%) 339.52 KiB (1%) 2459
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "brownal"] 16.431 s (5%) 13.384 ms 201.87 MiB (1%) 1467003
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "broyden3d"] 24.401 ms (5%) 213.19 KiB (1%) 1469
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "brybnd"] 64.414 ms (5%) 213.19 KiB (1%) 1469
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "dixon3dq"] 8.784 ms (5%) 205.31 KiB (1%) 1469
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "errinros_mod"] 63.892 ms (5%) 340.28 KiB (1%) 2465
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "freuroth"] 75.016 ms (5%) 340.28 KiB (1%) 2465
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "hovercraft1d"] 1.698 ms (5%) 119.56 KiB (1%) 797
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "integreq"] 16.983 s (5%) 213.19 KiB (1%) 1469
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "morebv"] 36.123 ms (5%) 213.19 KiB (1%) 1469
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "penalty1"] 18.737 ms (5%) 213.19 KiB (1%) 1469
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "power"] 2.658 ms (5%) 85.33 KiB (1%) 467
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "sbrybnd"] 70.599 ms (5%) 213.19 KiB (1%) 1469
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "spmsrtls"] 440.148 ms (5%) 2.20 MiB (1%) 16761
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "tquartic"] 11.721 ms (5%) 212.42 KiB (1%) 1463
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "camshape"] 40.212 ms (5%) 87.74 MiB (1%) 111182
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "catenary"] 11.142 ms (5%) 22.42 MiB (1%) 32056
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "chain"] 6.964 ms (5%) 18.11 MiB (1%) 45566
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "channel"] 99.653 ms (5%) 2.688 ms 142.69 MiB (1%) 140763
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "clnlbeam"] 5.202 ms (5%) 13.25 MiB (1%) 42865
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "controlinvestment"] 11.660 ms (5%) 26.53 MiB (1%) 60813
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "elec"] 12.219 s (5%) 179.918 ms 14.97 GiB (1%) 5388323
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "hovercraft1d"] 1.561 ms (5%) 4.01 MiB (1%) 13079
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "marine"] 4.506 ms (5%) 9.90 MiB (1%) 34892
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "polygon1"] 29.523 ms (5%) 50.89 MiB (1%) 35354
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "polygon3"] 33.916 ms (5%) 73.07 MiB (1%) 70945
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "robotarm"] 25.248 ms (5%) 53.47 MiB (1%) 47336
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "structural"] 3.752 ms (5%) 14.92 MiB (1%) 73021
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "camshape"] 543.733 ms (5%) 34.032 ms 323.02 MiB (1%) 1610436
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "catenary"] 110.609 ms (5%) 57.36 MiB (1%) 680075
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "chain"] 136.734 ms (5%) 67.82 MiB (1%) 920480
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "channel"] 705.607 ms (5%) 283.75 MiB (1%) 3961102
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "clnlbeam"] 136.607 ms (5%) 68.29 MiB (1%) 791400
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "controlinvestment"] 121.199 ms (5%) 71.27 MiB (1%) 807912
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "elec"] 425.819 s (5%) 3.498 s 36.56 GiB (1%) 104914856
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "hovercraft1d"] 13.137 ms (5%) 11.10 MiB (1%) 103091
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "marine"] 88.979 ms (5%) 45.43 MiB (1%) 498100
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "polygon1"] 50.736 ms (5%) 32.82 MiB (1%) 355793
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "polygon3"] 214.937 ms (5%) 144.92 MiB (1%) 970065
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "robotarm"] 171.958 ms (5%) 7.261 ms 101.29 MiB (1%) 840073
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "structural"] 139.485 ms (5%) 151.45 MiB (1%) 442506

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["hess_coord", "optimized", "Float64", "scalable_cons", "sparse"]
  • ["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse"]
  • ["hessian_backend", "optimized", "Float64", "scalable", "sparse"]
  • ["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics"]

Julia versioninfo

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1023-azure #24~22.04.1-Ubuntu SMP Wed Jun 12 19:55:26 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3244 MHz      29721 s          0 s       1044 s      75233 s          0 s
       #2  2445 MHz      31295 s          0 s       1093 s      73628 s          0 s
       #3  2593 MHz      30215 s          0 s       1097 s      74683 s          0 s
       #4  2445 MHz      23582 s          0 s       1275 s      81143 s          0 s
  Memory: 15.606491088867188 GB (12823.91796875 MB free)
  Uptime: 10618.24 sec
  Load Avg:  1.05  1.05  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture:                       x86_64
CPU op-mode(s):                     32-bit, 64-bit
Address sizes:                      48 bits physical, 48 bits virtual
Byte Order:                         Little Endian
CPU(s):                             4
On-line CPU(s) list:                0-3
Vendor ID:                          AuthenticAMD
Model name:                         AMD EPYC 7763 64-Core Processor
CPU family:                         25
Model:                              1
Thread(s) per core:                 2
Core(s) per socket:                 2
Socket(s):                          1
Stepping:                           1
BogoMIPS:                           4890.83
Flags:                              fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization:                     AMD-V
Hypervisor vendor:                  Microsoft
Virtualization type:                full
L1d cache:                          64 KiB (2 instances)
L1i cache:                          64 KiB (2 instances)
L2 cache:                           1 MiB (2 instances)
L3 cache:                           32 MiB (1 instance)
NUMA node(s):                       1
NUMA node0 CPU(s):                  0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit:        Not affected
Vulnerability L1tf:                 Not affected
Vulnerability Mds:                  Not affected
Vulnerability Meltdown:             Not affected
Vulnerability Mmio stale data:      Not affected
Vulnerability Retbleed:             Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass:    Vulnerable
Vulnerability Spectre v1:           Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:           Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds:                Not affected
Vulnerability Tsx async abort:      Not affected
Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft

@github-actions GitHub Actions
Copy link
Contributor

Benchmark result

Judge result

Benchmark Report for /home/runner/work/ADNLPModels.jl/ADNLPModels.jl

Job Properties

  • Time of benchmarks:
    • Target: 11 Jul 2024 - 21:55
    • Baseline: 11 Jul 2024 - 22:50
  • Package commits:
    • Target: 7133c2
    • Baseline: e89bd3
  • Julia commits:
    • Target: 48d4fd
    • Baseline: 48d4fd
  • Julia command flags:
    • Target: None
    • Baseline: None
  • Environment variables:
    • Target: None
    • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "camshape"] 1.05 (5%) ❌ 1.00 (1%)
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "catenary"] 1.09 (5%) ❌ 1.00 (1%)
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "chain"] 1.06 (5%) ❌ 1.00 (1%)
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "channel"] 1.17 (5%) ❌ 1.00 (1%)
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "hovercraft1d"] 0.70 (5%) ✅ 1.00 (1%)
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "polygon3"] 1.08 (5%) ❌ 1.00 (1%)
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "structural"] 0.94 (5%) ✅ 1.00 (1%)
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "broyden3d"] 0.93 (5%) ✅ 1.00 (1%)
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "hovercraft1d"] 1.03 (5%) 1.01 (1%) ❌
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "hovercraft1d"] 0.89 (5%) ✅ 1.00 (1%)
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "polygon3"] 1.06 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["hess_coord", "optimized", "Float64", "scalable_cons", "sparse"]
  • ["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse"]
  • ["hessian_backend", "optimized", "Float64", "scalable", "sparse"]
  • ["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics"]

Julia versioninfo

Target

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1023-azure #24~22.04.1-Ubuntu SMP Wed Jun 12 19:55:26 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2593 MHz      23319 s          0 s        768 s      49903 s          0 s
       #2  2445 MHz      23522 s          0 s        780 s      49690 s          0 s
       #3  2445 MHz      19972 s          0 s        825 s      53186 s          0 s
       #4  3244 MHz      16275 s          0 s        952 s      56754 s          0 s
  Memory: 15.606491088867188 GB (11704.1484375 MB free)
  Uptime: 7412.56 sec
  Load Avg:  1.03  1.03  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1023-azure #24~22.04.1-Ubuntu SMP Wed Jun 12 19:55:26 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3242 MHz      32587 s          0 s       1032 s      73048 s          0 s
       #2  3286 MHz      32302 s          0 s       1092 s      73278 s          0 s
       #3  2445 MHz      28213 s          0 s       1117 s      77331 s          0 s
       #4  2445 MHz      22707 s          0 s       1290 s      82661 s          0 s
  Memory: 15.606491088867188 GB (12906.97265625 MB free)
  Uptime: 10685.28 sec
  Load Avg:  1.06  1.04  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/ADNLPModels.jl/ADNLPModels.jl

Job Properties

  • Time of benchmark: 11 Jul 2024 - 21:55
  • Package commit: 7133c2
  • Julia commit: 48d4fd
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "camshape"] 429.531 ms (5%) 1.63 MiB (1%) 12350
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "catenary"] 12.225 ms (5%) 369.45 KiB (1%) 2390
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "chain"] 22.856 ms (5%) 283.58 KiB (1%) 1931
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "channel"] 619.945 ms (5%) 1.12 MiB (1%) 7710
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "clnlbeam"] 13.781 ms (5%) 124.95 KiB (1%) 800
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "controlinvestment"] 18.566 ms (5%) 145.08 KiB (1%) 968
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "elec"] 912.994 s (5%) 13.150 ms 232.44 MiB (1%) 1905099
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "hovercraft1d"] 585.693 μs (5%) 5.57 MiB (1%) 386
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "marine"] 407.987 ms (5%) 11.353 ms 193.42 MiB (1%) 1027996
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "polygon1"] 27.673 ms (5%) 334.39 KiB (1%) 1923
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "polygon3"] 104.876 ms (5%) 829.52 KiB (1%) 5873
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "robotarm"] 12.678 s (5%) 132.42 MiB (1%) 981023
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "structural"] 13.859 ms (5%) 96.47 KiB (1%) 854
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "arglina"] 49.029 ms (5%) 332.41 KiB (1%) 2465
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "arglinb"] 41.697 ms (5%) 332.41 KiB (1%) 2465
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "bdqrtic"] 73.320 ms (5%) 339.52 KiB (1%) 2459
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "brownal"] 16.117 s (5%) 4.910 ms 201.87 MiB (1%) 1467003
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "broyden3d"] 24.268 ms (5%) 213.19 KiB (1%) 1469
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "brybnd"] 64.425 ms (5%) 213.19 KiB (1%) 1469
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "dixon3dq"] 8.755 ms (5%) 205.31 KiB (1%) 1469
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "errinros_mod"] 63.388 ms (5%) 340.28 KiB (1%) 2465
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "freuroth"] 73.910 ms (5%) 340.28 KiB (1%) 2465
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "hovercraft1d"] 1.694 ms (5%) 119.56 KiB (1%) 797
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "integreq"] 16.923 s (5%) 213.19 KiB (1%) 1469
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "morebv"] 37.646 ms (5%) 213.19 KiB (1%) 1469
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "penalty1"] 18.646 ms (5%) 213.19 KiB (1%) 1469
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "power"] 2.640 ms (5%) 85.33 KiB (1%) 467
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "sbrybnd"] 71.494 ms (5%) 213.19 KiB (1%) 1469
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "spmsrtls"] 436.467 ms (5%) 2.20 MiB (1%) 16761
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "tquartic"] 11.752 ms (5%) 212.42 KiB (1%) 1463
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "camshape"] 41.367 ms (5%) 87.82 MiB (1%) 111211
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "catenary"] 11.419 ms (5%) 22.47 MiB (1%) 32075
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "chain"] 7.044 ms (5%) 18.17 MiB (1%) 45581
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "channel"] 104.414 ms (5%) 2.841 ms 142.72 MiB (1%) 140799
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "clnlbeam"] 5.299 ms (5%) 13.29 MiB (1%) 42875
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "controlinvestment"] 11.760 ms (5%) 26.58 MiB (1%) 60823
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "elec"] 12.762 s (5%) 185.074 ms 14.97 GiB (1%) 5390328
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "hovercraft1d"] 1.609 ms (5%) 4.05 MiB (1%) 13089
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "marine"] 4.538 ms (5%) 9.94 MiB (1%) 34967
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "polygon1"] 30.407 ms (5%) 50.91 MiB (1%) 35388
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "polygon3"] 34.917 ms (5%) 73.13 MiB (1%) 70969
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "robotarm"] 26.095 ms (5%) 53.71 MiB (1%) 48697
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "structural"] 3.741 ms (5%) 15.03 MiB (1%) 73032
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "camshape"] 534.004 ms (5%) 37.083 ms 323.10 MiB (1%) 1610465
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "catenary"] 109.250 ms (5%) 57.41 MiB (1%) 680094
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "chain"] 134.917 ms (5%) 67.88 MiB (1%) 920495
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "channel"] 673.145 ms (5%) 63.269 ms 283.78 MiB (1%) 3961138
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "clnlbeam"] 133.649 ms (5%) 68.39 MiB (1%) 792406
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "controlinvestment"] 118.926 ms (5%) 71.31 MiB (1%) 807922
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "elec"] 477.353 s (5%) 2.943 s 36.56 GiB (1%) 104916861
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "hovercraft1d"] 11.361 ms (5%) 11.15 MiB (1%) 103101
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "marine"] 88.512 ms (5%) 45.46 MiB (1%) 498175
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "polygon1"] 50.013 ms (5%) 32.93 MiB (1%) 357327
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "polygon3"] 226.029 ms (5%) 10.500 ms 144.98 MiB (1%) 970089
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "robotarm"] 165.379 ms (5%) 101.53 MiB (1%) 841434
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "structural"] 140.639 ms (5%) 2.811 ms 151.56 MiB (1%) 442517

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["hess_coord", "optimized", "Float64", "scalable_cons", "sparse"]
  • ["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse"]
  • ["hessian_backend", "optimized", "Float64", "scalable", "sparse"]
  • ["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics"]

Julia versioninfo

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1023-azure #24~22.04.1-Ubuntu SMP Wed Jun 12 19:55:26 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2593 MHz      23319 s          0 s        768 s      49903 s          0 s
       #2  2445 MHz      23522 s          0 s        780 s      49690 s          0 s
       #3  2445 MHz      19972 s          0 s        825 s      53186 s          0 s
       #4  3244 MHz      16275 s          0 s        952 s      56754 s          0 s
  Memory: 15.606491088867188 GB (11704.1484375 MB free)
  Uptime: 7412.56 sec
  Load Avg:  1.03  1.03  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/ADNLPModels.jl/ADNLPModels.jl

Job Properties

  • Time of benchmark: 11 Jul 2024 - 22:50
  • Package commit: e89bd3
  • Julia commit: 48d4fd
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "camshape"] 408.804 ms (5%) 1.63 MiB (1%) 12350
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "catenary"] 11.248 ms (5%) 369.45 KiB (1%) 2390
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "chain"] 21.561 ms (5%) 283.58 KiB (1%) 1931
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "channel"] 531.846 ms (5%) 1.12 MiB (1%) 7710
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "clnlbeam"] 13.880 ms (5%) 124.95 KiB (1%) 800
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "controlinvestment"] 17.965 ms (5%) 145.08 KiB (1%) 968
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "elec"] 911.753 s (5%) 9.872 ms 232.44 MiB (1%) 1905099
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "hovercraft1d"] 840.545 μs (5%) 5.57 MiB (1%) 386
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "marine"] 395.208 ms (5%) 9.137 ms 193.42 MiB (1%) 1027996
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "polygon1"] 27.716 ms (5%) 334.39 KiB (1%) 1923
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "polygon3"] 96.989 ms (5%) 829.52 KiB (1%) 5873
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "robotarm"] 12.976 s (5%) 314.834 ms 132.42 MiB (1%) 981023
["hess_coord", "optimized", "Float64", "scalable_cons", "sparse", "structural"] 14.754 ms (5%) 96.47 KiB (1%) 854
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "arglina"] 49.135 ms (5%) 332.41 KiB (1%) 2465
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "arglinb"] 41.722 ms (5%) 332.41 KiB (1%) 2465
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "bdqrtic"] 73.121 ms (5%) 339.52 KiB (1%) 2459
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "brownal"] 16.347 s (5%) 14.257 ms 201.87 MiB (1%) 1467003
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "broyden3d"] 26.130 ms (5%) 213.19 KiB (1%) 1469
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "brybnd"] 64.630 ms (5%) 213.19 KiB (1%) 1469
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "dixon3dq"] 8.823 ms (5%) 205.31 KiB (1%) 1469
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "errinros_mod"] 63.287 ms (5%) 340.28 KiB (1%) 2465
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "freuroth"] 74.171 ms (5%) 340.28 KiB (1%) 2465
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "hovercraft1d"] 1.708 ms (5%) 119.56 KiB (1%) 797
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "integreq"] 16.980 s (5%) 213.19 KiB (1%) 1469
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "morebv"] 36.144 ms (5%) 213.19 KiB (1%) 1469
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "penalty1"] 18.594 ms (5%) 213.19 KiB (1%) 1469
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "power"] 2.647 ms (5%) 85.33 KiB (1%) 467
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "sbrybnd"] 70.665 ms (5%) 213.19 KiB (1%) 1469
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "spmsrtls"] 437.106 ms (5%) 2.20 MiB (1%) 16761
["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse", "tquartic"] 11.702 ms (5%) 212.42 KiB (1%) 1463
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "camshape"] 40.768 ms (5%) 87.74 MiB (1%) 111182
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "catenary"] 11.349 ms (5%) 22.42 MiB (1%) 32056
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "chain"] 7.004 ms (5%) 18.11 MiB (1%) 45566
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "channel"] 100.020 ms (5%) 2.584 ms 142.69 MiB (1%) 140763
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "clnlbeam"] 5.172 ms (5%) 13.25 MiB (1%) 42865
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "controlinvestment"] 11.672 ms (5%) 26.53 MiB (1%) 60813
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "elec"] 12.310 s (5%) 165.629 ms 14.97 GiB (1%) 5388323
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "hovercraft1d"] 1.566 ms (5%) 4.01 MiB (1%) 13079
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "marine"] 4.457 ms (5%) 9.90 MiB (1%) 34892
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "polygon1"] 29.834 ms (5%) 50.89 MiB (1%) 35354
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "polygon3"] 34.720 ms (5%) 73.07 MiB (1%) 70945
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "robotarm"] 26.018 ms (5%) 53.47 MiB (1%) 47348
["hessian_backend", "optimized", "Float64", "scalable", "sparse", "structural"] 3.588 ms (5%) 14.92 MiB (1%) 73021
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "camshape"] 535.634 ms (5%) 37.344 ms 322.47 MiB (1%) 1601436
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "catenary"] 108.480 ms (5%) 57.18 MiB (1%) 677087
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "chain"] 135.788 ms (5%) 67.73 MiB (1%) 918986
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "channel"] 690.494 ms (5%) 65.214 ms 283.75 MiB (1%) 3961102
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "clnlbeam"] 135.621 ms (5%) 68.29 MiB (1%) 791400
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "controlinvestment"] 118.583 ms (5%) 71.27 MiB (1%) 807912
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "elec"] 465.430 s (5%) 3.430 s 36.56 GiB (1%) 104914856
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "hovercraft1d"] 12.746 ms (5%) 11.10 MiB (1%) 103091
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "marine"] 86.912 ms (5%) 45.43 MiB (1%) 498100
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "polygon1"] 49.989 ms (5%) 32.82 MiB (1%) 355793
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "polygon3"] 214.049 ms (5%) 144.92 MiB (1%) 970065
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "robotarm"] 167.554 ms (5%) 6.538 ms 101.29 MiB (1%) 840085
["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics", "structural"] 141.001 ms (5%) 2.528 ms 151.45 MiB (1%) 442506

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["hess_coord", "optimized", "Float64", "scalable_cons", "sparse"]
  • ["hess_coord_residual", "optimized", "Float64", "scalable_nls", "sparse"]
  • ["hessian_backend", "optimized", "Float64", "scalable", "sparse"]
  • ["hessian_backend", "optimized", "Float64", "scalable", "sparse_symbolics"]

Julia versioninfo

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1023-azure #24~22.04.1-Ubuntu SMP Wed Jun 12 19:55:26 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3242 MHz      32587 s          0 s       1032 s      73048 s          0 s
       #2  3286 MHz      32302 s          0 s       1092 s      73278 s          0 s
       #3  2445 MHz      28213 s          0 s       1117 s      77331 s          0 s
       #4  2445 MHz      22707 s          0 s       1290 s      82661 s          0 s
  Memory: 15.606491088867188 GB (12906.97265625 MB free)
  Uptime: 10685.28 sec
  Load Avg:  1.06  1.04  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture:                       x86_64
CPU op-mode(s):                     32-bit, 64-bit
Address sizes:                      48 bits physical, 48 bits virtual
Byte Order:                         Little Endian
CPU(s):                             4
On-line CPU(s) list:                0-3
Vendor ID:                          AuthenticAMD
Model name:                         AMD EPYC 7763 64-Core Processor
CPU family:                         25
Model:                              1
Thread(s) per core:                 2
Core(s) per socket:                 2
Socket(s):                          1
Stepping:                           1
BogoMIPS:                           4890.86
Flags:                              fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization:                     AMD-V
Hypervisor vendor:                  Microsoft
Virtualization type:                full
L1d cache:                          64 KiB (2 instances)
L1i cache:                          64 KiB (2 instances)
L2 cache:                           1 MiB (2 instances)
L3 cache:                           32 MiB (1 instance)
NUMA node(s):                       1
NUMA node0 CPU(s):                  0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit:        Not affected
Vulnerability L1tf:                 Not affected
Vulnerability Mds:                  Not affected
Vulnerability Meltdown:             Not affected
Vulnerability Mmio stale data:      Not affected
Vulnerability Retbleed:             Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass:    Vulnerable
Vulnerability Spectre v1:           Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:           Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds:                Not affected
Vulnerability Tsx async abort:      Not affected
Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft

@amontoison amontoison merged commit 406d4ad into main Jul 11, 2024
83 of 86 checks passed
@amontoison amontoison deleted the optimization_sparse branch July 11, 2024 23:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
run Hessian benchmark run Jacobian benchmark
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@amontoison