Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ci: Run cargo-deny during ci #2340

Merged
merged 4 commits into from
Jan 13, 2025
Merged

Conversation

larseggert
Copy link
Collaborator

@larseggert larseggert commented Jan 10, 2025

Oh wow, an action that is actually already allowlisted :-)

@larseggert larseggert marked this pull request as ready for review January 10, 2025 09:49
Copy link

codecov bot commented Jan 10, 2025

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 95.29%. Comparing base (8f5233a) to head (34bed60).
Report is 9 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #2340      +/-   ##
==========================================
+ Coverage   93.01%   95.29%   +2.28%     
==========================================
  Files         114      114              
  Lines       36844    36844              
  Branches    36844    36844              
==========================================
+ Hits        34270    35111     +841     
+ Misses       1796     1727      -69     
+ Partials      778        6     -772     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link

github-actions bot commented Jan 10, 2025

Failed Interop Tests

QUIC Interop Runner, client vs. server, differences relative to 085fa62.

neqo-latest as client

neqo-latest as server

All results

Succeeded Interop Tests

QUIC Interop Runner, client vs. server

neqo-latest as client

neqo-latest as server

Unsupported Interop Tests

QUIC Interop Runner, client vs. server

neqo-latest as client

neqo-latest as server

Copy link
Collaborator

@mxinden mxinden left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Seems like mozilla-central is using it too, but I can't find the "manifest". Did you?

https://searchfox.org/mozilla-central/rev/9f9fa5d2cb72b12ac7e168b7f6ee9820f63291e9/build/cargo/cargo-deny.yaml#7

Copy link

Benchmark results

Performance differences relative to 085fa62.

decode 4096 bytes, mask ff: No change in performance detected.
       time:   [11.173 µs 11.214 µs 11.260 µs]
       change: [-0.2279% +0.9302% +2.8330%] (p = 0.33 > 0.05)

Found 17 outliers among 100 measurements (17.00%)
1 (1.00%) low severe
3 (3.00%) low mild
13 (13.00%) high severe

decode 1048576 bytes, mask ff: No change in performance detected.
       time:   [3.0172 ms 3.0263 ms 3.0368 ms]
       change: [-1.0661% -0.3697% +0.2125%] (p = 0.27 > 0.05)

Found 10 outliers among 100 measurements (10.00%)
10 (10.00%) high severe

decode 4096 bytes, mask 7f: No change in performance detected.
       time:   [19.509 µs 19.555 µs 19.607 µs]
       change: [-0.4173% -0.1342% +0.1507%] (p = 0.37 > 0.05)

Found 16 outliers among 100 measurements (16.00%)
1 (1.00%) low severe
3 (3.00%) low mild
1 (1.00%) high mild
11 (11.00%) high severe

decode 1048576 bytes, mask 7f: No change in performance detected.
       time:   [5.1611 ms 5.1740 ms 5.1888 ms]
       change: [-1.3122% -0.3914% +0.2599%] (p = 0.40 > 0.05)

Found 14 outliers among 100 measurements (14.00%)
14 (14.00%) high severe

decode 4096 bytes, mask 3f: No change in performance detected.
       time:   [5.5296 µs 5.5467 µs 5.5708 µs]
       change: [-0.4717% +0.1799% +0.9969%] (p = 0.65 > 0.05)

Found 16 outliers among 100 measurements (16.00%)
5 (5.00%) low mild
4 (4.00%) high mild
7 (7.00%) high severe

decode 1048576 bytes, mask 3f: No change in performance detected.
       time:   [1.7593 ms 1.7665 ms 1.7779 ms]
       change: [-0.0052% +0.4690% +1.1034%] (p = 0.08 > 0.05)

Found 7 outliers among 100 measurements (7.00%)
3 (3.00%) high mild
4 (4.00%) high severe

coalesce_acked_from_zero 1+1 entries: No change in performance detected.
       time:   [98.902 ns 99.180 ns 99.473 ns]
       change: [-0.4028% +0.0789% +0.6283%] (p = 0.79 > 0.05)

Found 11 outliers among 100 measurements (11.00%)
7 (7.00%) high mild
4 (4.00%) high severe

coalesce_acked_from_zero 3+1 entries: No change in performance detected.
       time:   [116.82 ns 117.20 ns 117.61 ns]
       change: [-0.5490% +0.1012% +0.8129%] (p = 0.79 > 0.05)

Found 20 outliers among 100 measurements (20.00%)
3 (3.00%) low mild
4 (4.00%) high mild
13 (13.00%) high severe

coalesce_acked_from_zero 10+1 entries: No change in performance detected.
       time:   [116.35 ns 116.82 ns 117.38 ns]
       change: [-0.5582% -0.0984% +0.3644%] (p = 0.68 > 0.05)

Found 17 outliers among 100 measurements (17.00%)
7 (7.00%) low severe
2 (2.00%) low mild
1 (1.00%) high mild
7 (7.00%) high severe

coalesce_acked_from_zero 1000+1 entries: No change in performance detected.
       time:   [96.940 ns 97.070 ns 97.233 ns]
       change: [-1.1387% -0.3182% +0.5344%] (p = 0.49 > 0.05)

Found 14 outliers among 100 measurements (14.00%)
4 (4.00%) high mild
10 (10.00%) high severe

RxStreamOrderer::inbound_frame(): No change in performance detected.
       time:   [111.15 ms 111.28 ms 111.49 ms]
       change: [-0.2159% -0.0167% +0.2077%] (p = 0.89 > 0.05)

Found 10 outliers among 100 measurements (10.00%)
6 (6.00%) low mild
3 (3.00%) high mild
1 (1.00%) high severe

SentPackets::take_ranges: No change in performance detected.
       time:   [5.4691 µs 5.6527 µs 5.8481 µs]
       change: [-3.0894% -0.3389% +2.5986%] (p = 0.81 > 0.05)

Found 7 outliers among 100 measurements (7.00%)
6 (6.00%) high mild
1 (1.00%) high severe

transfer/pacing-false/varying-seeds: Change within noise threshold.
       time:   [41.643 ms 41.723 ms 41.804 ms]
       change: [-0.5981% -0.3109% -0.0521%] (p = 0.03 < 0.05)
transfer/pacing-true/varying-seeds: Change within noise threshold.
       time:   [41.649 ms 41.720 ms 41.790 ms]
       change: [-1.0793% -0.8032% -0.5419%] (p = 0.00 < 0.05)
transfer/pacing-false/same-seed: Change within noise threshold.
       time:   [41.619 ms 41.677 ms 41.738 ms]
       change: [-1.0263% -0.8134% -0.6003%] (p = 0.00 < 0.05)

Found 7 outliers among 100 measurements (7.00%)
1 (1.00%) low mild
6 (6.00%) high mild

transfer/pacing-true/same-seed: Change within noise threshold.
       time:   [41.533 ms 41.611 ms 41.697 ms]
       change: [+0.0269% +0.3007% +0.5509%] (p = 0.03 < 0.05)

Found 2 outliers among 100 measurements (2.00%)
1 (1.00%) low mild
1 (1.00%) high severe

1-conn/1-100mb-resp/mtu-1504 (aka. Download)/client: 💚 Performance has improved.
       time:   [871.21 ms 880.29 ms 889.76 ms]
       thrpt:  [112.39 MiB/s 113.60 MiB/s 114.78 MiB/s]
change:
       time:   [-6.3251% -4.9075% -3.3873%] (p = 0.00 < 0.05)
       thrpt:  [+3.5060% +5.1608% +6.7522%]

Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild

1-conn/10_000-parallel-1b-resp/mtu-1504 (aka. RPS)/client: No change in performance detected.
       time:   [316.08 ms 318.48 ms 321.02 ms]
       thrpt:  [31.151 Kelem/s 31.399 Kelem/s 31.637 Kelem/s]
change:
       time:   [-1.1781% -0.0925% +0.9610%] (p = 0.86 > 0.05)
       thrpt:  [-0.9519% +0.0926% +1.1922%]

Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild

1-conn/1-1b-resp/mtu-1504 (aka. HPS)/client: No change in performance detected.
       time:   [34.163 ms 34.334 ms 34.523 ms]
       thrpt:  [28.966  elem/s 29.125  elem/s 29.271  elem/s]
change:
       time:   [-0.6592% +0.0616% +0.8311%] (p = 0.87 > 0.05)
       thrpt:  [-0.8242% -0.0616% +0.6636%]

Found 9 outliers among 100 measurements (9.00%)
1 (1.00%) low severe
3 (3.00%) low mild
1 (1.00%) high mild
4 (4.00%) high severe

1-conn/1-100mb-resp/mtu-1504 (aka. Upload)/client: No change in performance detected.
       time:   [1.6777 s 1.6958 s 1.7137 s]
       thrpt:  [58.355 MiB/s 58.970 MiB/s 59.604 MiB/s]
change:
       time:   [-2.2139% -0.7700% +0.6913%] (p = 0.28 > 0.05)
       thrpt:  [-0.6866% +0.7760% +2.2640%]

Client/server transfer results

Transfer of 33554432 bytes over loopback.

Client Server CC Pacing MTU Mean [ms] Min [ms] Max [ms]
gquiche gquiche 1504 566.2 ± 101.9 508.4 777.7
neqo gquiche reno on 1504 761.9 ± 25.2 741.3 830.6
neqo gquiche reno 1504 774.0 ± 59.7 735.2 937.4
neqo gquiche cubic on 1504 752.2 ± 33.7 716.2 836.2
neqo gquiche cubic 1504 737.2 ± 28.6 699.5 804.3
msquic msquic 1504 144.4 ± 79.3 91.8 354.9
neqo msquic reno on 1504 267.9 ± 82.2 207.9 444.8
neqo msquic reno 1504 216.3 ± 21.4 200.2 281.8
neqo msquic cubic on 1504 213.1 ± 13.1 199.5 241.2
neqo msquic cubic 1504 216.2 ± 10.3 202.2 231.9
gquiche neqo reno on 1504 720.7 ± 165.6 554.4 1107.8
gquiche neqo reno 1504 676.5 ± 94.9 548.9 873.1
gquiche neqo cubic on 1504 667.3 ± 83.1 546.4 787.3
gquiche neqo cubic 1504 700.4 ± 114.0 556.6 918.2
msquic neqo reno on 1504 468.7 ± 10.7 459.6 493.0
msquic neqo reno 1504 519.3 ± 104.8 445.7 748.8
msquic neqo cubic on 1504 467.7 ± 10.3 455.3 487.1
msquic neqo cubic 1504 482.1 ± 5.8 470.5 489.1
neqo neqo reno on 1504 496.0 ± 66.8 443.1 640.4
neqo neqo reno 1504 443.8 ± 16.9 416.0 465.4
neqo neqo cubic on 1504 474.9 ± 61.4 443.3 646.0
neqo neqo cubic 1504 468.8 ± 16.8 449.3 508.2

⬇️ Download logs

@larseggert larseggert enabled auto-merge January 13, 2025 18:04
@larseggert larseggert added this pull request to the merge queue Jan 13, 2025
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Jan 13, 2025
@larseggert larseggert merged commit 8bc926a into mozilla:main Jan 13, 2025
65 of 70 checks passed
@larseggert larseggert deleted the ci-cargo-deny branch January 14, 2025 08:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants