Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[PROF-11306] Package libdatadog v16.0.1 for Ruby #864

Merged
merged 3 commits into from
Feb 10, 2025
Merged

[PROF-11306] Package libdatadog v16.0.1 for Ruby #864

merged 3 commits into from
Feb 10, 2025

Conversation

ivoanjo
Copy link
Member

@ivoanjo ivoanjo commented Feb 7, 2025

What does this PR do?

This PR includes the changes documented in the "Releasing a new version to rubygems.org" part of the README:
https://github.com/datadog/libdatadog/tree/main/ruby#releasing-a-new-version-to-rubygemsorg

Motivation

Enable Ruby to use libdatadog v16.0.1. Of particular interest, this includes improvements to crashtracking and the managed string table needed by DataDog/dd-trace-rb#4331 .

Additional Notes

N/A

How to test the change?

I've tested this release locally using the changes in DataDog/dd-trace-rb#4353 .

As a reminder, new libdatadog releases don't get automatically picked up by dd-trace-rb, so the PR that bumps the Ruby profiler will also test this release against all supported Ruby versions.

@ivoanjo
[PROF-11306] Package libdatadog v16.0.1 for Ruby
385a98d 
**What does this PR do?**

This PR includes the changes documented in the "Releasing a new version
to rubygems.org" part of the README:
https://github.com/datadog/libdatadog/tree/main/ruby#releasing-a-new-version-to-rubygemsorg

**Motivation:**

Enable Ruby to use libdatadog v16.0.1. Of particular interest, this
includes improvements to crashtracking and the managed string table
needed by DataDog/dd-trace-rb#4331 .

**Additional Notes:**

N/A

**How to test the change?**

I've tested this release locally using the changes in
DataDog/dd-trace-rb#4353 .

As a reminder, new libdatadog releases don't get automatically picked up
by dd-trace-rb, so the PR that bumps the Ruby profiler will also test
this release against all supported Ruby versions.
@ivoanjo ivoanjo requested review from a team as code owners February 7, 2025 11:02
@pr-commenter
Copy link

pr-commenter bot commented Feb 7, 2025 •
edited
Loading

Benchmarks

Comparison

Benchmark execution time: 2025-02-10 09:48:06

Comparing candidate commit 00dea93 in PR branch ivoanjo/prof-11306-libdatadog16_0-ruby with baseline commit b581706 in branch main.

Found 0 performance improvements and 4 performance regressions! Performance is the same for 48 metrics, 2 unstable metrics.

scenario:credit_card/is_card_number/37828224631000521389798

  • 🟥 execution_time [+10.173µs; +10.195µs] or [+17.218%; +17.256%]
  • 🟥 throughput [-2491073.672op/s; -2485916.620op/s] or [-14.718%; -14.687%]

scenario:credit_card/is_card_number_no_luhn/37828224631000521389798

  • 🟥 execution_time [+10.179µs; +10.201µs] or [+17.229%; +17.267%]
  • 🟥 throughput [-2492626.113op/s; -2487561.051op/s] or [-14.726%; -14.696%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 00dea93 1739180223 ivoanjo/prof-11306-libdatadog16_0-ruby
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.730µs 2.772µs ± 0.013µs 2.771µs ± 0.008µs 2.778µs 2.798µs 2.802µs 2.813µs 1.51% 0.212 0.653 0.47% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.770µs; 2.774µs] or [-0.066%; +0.066%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 00dea93 1739180223 ivoanjo/prof-11306-libdatadog16_0-ruby
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 428.197µs 429.631µs ± 0.972µs 429.521µs ± 0.302µs 429.833µs 430.244µs 434.138µs 436.076µs 1.53% 4.047 19.849 0.23% 0.069µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 2293179.305op/s 2327588.522op/s ± 5216.366op/s 2328175.009op/s ± 1637.953op/s 2329735.775op/s 2332498.460op/s 2333545.536op/s 2335372.853op/s 0.31% -4.010 19.573 0.22% 368.853op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 470.196µs 471.051µs ± 0.565µs 470.991µs ± 0.221µs 471.212µs 471.679µs 472.151µs 475.855µs 1.03% 4.964 37.383 0.12% 0.040µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2101478.634op/s 2122916.598op/s ± 2529.783op/s 2123181.041op/s ± 995.304op/s 2124164.753op/s 2125451.402op/s 2126282.208op/s 2126771.237op/s 0.17% -4.911 36.825 0.12% 178.883op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 161.717µs 162.697µs ± 0.507µs 162.678µs ± 0.123µs 162.795µs 162.966µs 163.147µs 167.680µs 3.07% 7.311 65.668 0.31% 0.036µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5963733.183op/s 6146465.409op/s ± 18728.885op/s 6147110.555op/s ± 4638.712op/s 6152590.036op/s 6162702.949op/s 6170579.012op/s 6183639.187op/s 0.59% -7.179 64.091 0.30% 1324.332op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 45.502µs 45.729µs ± 0.071µs 45.735µs ± 0.047µs 45.777µs 45.839µs 45.860µs 45.896µs 0.35% -0.335 -0.115 0.16% 0.005µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 21788173.290op/s 21868175.091op/s ± 34128.585op/s 21864956.491op/s ± 22523.871op/s 21890185.265op/s 21932536.483op/s 21949890.579op/s 21976860.774op/s 0.51% 0.343 -0.104 0.16% 2413.255op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 42.911µs 43.128µs ± 0.075µs 43.135µs ± 0.043µs 43.172µs 43.242µs 43.293µs 43.514µs 0.88% 0.445 2.893 0.17% 0.005µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 22981207.118op/s 23186664.086op/s ± 40364.772op/s 23183146.860op/s ± 22999.814op/s 23210791.706op/s 23254479.584op/s 23274311.308op/s 23304112.847op/s 0.52% -0.420 2.802 0.17% 2854.220op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [429.497µs; 429.766µs] or [-0.031%; +0.031%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [2326865.584op/s; 2328311.461op/s] or [-0.031%; +0.031%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [470.972µs; 471.129µs] or [-0.017%; +0.017%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2122565.995op/s; 2123267.202op/s] or [-0.017%; +0.017%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [162.626µs; 162.767µs] or [-0.043%; +0.043%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [6143869.765op/s; 6149061.052op/s] or [-0.042%; +0.042%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [45.719µs; 45.739µs] or [-0.022%; +0.022%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [21863445.197op/s; 21872904.984op/s] or [-0.022%; +0.022%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [43.118µs; 43.139µs] or [-0.024%; +0.024%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [23181069.917op/s; 23192258.256op/s] or [-0.024%; +0.024%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 00dea93 1739180223 ivoanjo/prof-11306-libdatadog16_0-ruby
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 18.570µs 28.088µs ± 13.769µs 19.201µs ± 0.550µs 36.441µs 45.954µs 49.293µs 149.534µs 678.80% 4.008 30.085 48.90% 0.974µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [26.179µs; 29.996µs] or [-6.794%; +6.794%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 00dea93 1739180223 ivoanjo/prof-11306-libdatadog16_0-ruby
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 38.345µs 39.139µs ± 1.418µs 38.501µs ± 0.061µs 38.570µs 42.188µs 42.245µs 43.259µs 12.36% 1.714 0.989 3.61% 0.100µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [38.942µs; 39.335µs] or [-0.502%; +0.502%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 00dea93 1739180223 ivoanjo/prof-11306-libdatadog16_0-ruby
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 5.422µs 5.496µs ± 0.040µs 5.504µs ± 0.040µs 5.536µs 5.555µs 5.559µs 5.560µs 1.02% -0.012 -1.275 0.73% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.490µs; 5.502µs] or [-0.102%; +0.102%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 00dea93 1739180223 ivoanjo/prof-11306-libdatadog16_0-ruby
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 211.507µs 217.981µs ± 2.837µs 218.016µs ± 1.818µs 219.786µs 222.740µs 223.824µs 224.569µs 3.01% 0.095 -0.480 1.30% 0.201µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4452979.321op/s 4588329.113op/s ± 59672.943op/s 4586816.727op/s ± 37953.798op/s 4625695.074op/s 4686634.003op/s 4717666.284op/s 4727982.116op/s 3.08% -0.036 -0.478 1.30% 4219.514op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 20.572µs 20.882µs ± 0.264µs 20.859µs ± 0.061µs 20.915µs 21.036µs 21.180µs 23.453µs 12.44% 7.951 71.576 1.26% 0.019µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 42638168.057op/s 47896132.565op/s ± 551923.928op/s 47940567.037op/s ± 139944.886op/s 48089382.695op/s 48279058.771op/s 48429866.412op/s 48610336.164op/s 1.40% -7.554 66.709 1.15% 39026.915op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 13.221µs 13.411µs ± 0.073µs 13.413µs ± 0.054µs 13.458µs 13.537µs 13.576µs 13.592µs 1.33% 0.154 -0.393 0.55% 0.005µs 1 200
normalization/normalize_name/normalize_name/good throughput 73573720.868op/s 74569328.962op/s ± 407545.984op/s 74555110.249op/s ± 299522.498op/s 74867911.613op/s 75149440.060op/s 75445952.522op/s 75636426.503op/s 1.45% -0.129 -0.397 0.55% 28817.853op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [217.588µs; 218.374µs] or [-0.180%; +0.180%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4580059.017op/s; 4596599.209op/s] or [-0.180%; +0.180%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [20.845µs; 20.918µs] or [-0.175%; +0.175%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [47819641.217op/s; 47972623.914op/s] or [-0.160%; +0.160%] None None None
normalization/normalize_name/normalize_name/good execution_time [13.401µs; 13.421µs] or [-0.076%; +0.076%] None None None
normalization/normalize_name/normalize_name/good throughput [74512847.008op/s; 74625810.916op/s] or [-0.076%; +0.076%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 00dea93 1739180223 ivoanjo/prof-11306-libdatadog16_0-ruby
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 4.270µs 4.285µs ± 0.003µs 4.285µs ± 0.001µs 4.287µs 4.290µs 4.291µs 4.297µs 0.28% -0.538 5.135 0.07% 0.000µs 1 200
credit_card/is_card_number/ throughput 232701523.108op/s 233359978.884op/s ± 153247.002op/s 233358917.166op/s ± 72854.159op/s 233420325.078op/s 233621745.584op/s 233731179.092op/s 234184588.627op/s 0.35% 0.552 5.165 0.07% 10836.199op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 96.645µs 98.299µs ± 0.756µs 98.186µs ± 0.506µs 98.761µs 99.553µs 100.007µs 102.551µs 4.45% 1.131 4.044 0.77% 0.053µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 9751254.030op/s 10173671.259op/s ± 77640.719op/s 10184758.958op/s ± 52281.685op/s 10227531.040op/s 10277731.775op/s 10325844.432op/s 10347186.274op/s 1.59% -1.026 3.451 0.76% 5490.028op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 91.742µs 93.011µs ± 0.612µs 93.027µs ± 0.353µs 93.356µs 93.634µs 93.802µs 98.754µs 6.16% 3.911 37.052 0.66% 0.043µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 10126200.588op/s 10751889.979op/s ± 69059.465op/s 10749600.515op/s ± 40889.838op/s 10791487.944op/s 10853884.331op/s 10889624.798op/s 10900189.088op/s 1.40% -3.466 31.991 0.64% 4883.242op/s 1 200
credit_card/is_card_number/37828224631 execution_time 4.270µs 4.286µs ± 0.004µs 4.286µs ± 0.001µs 4.287µs 4.291µs 4.296µs 4.332µs 1.08% 5.254 54.853 0.10% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 230848729.101op/s 233319759.657op/s ± 241747.154op/s 233333394.982op/s ± 72895.317op/s 233404895.670op/s 233606399.442op/s 233728761.970op/s 234198405.785op/s 0.37% -5.164 53.752 0.10% 17094.105op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 83.198µs 83.905µs ± 0.311µs 83.874µs ± 0.179µs 84.069µs 84.516µs 84.795µs 85.144µs 1.51% 0.822 1.333 0.37% 0.022µs 1 200
credit_card/is_card_number/378282246310005 throughput 11744868.569op/s 11918460.690op/s ± 44114.632op/s 11922653.579op/s ± 25515.868op/s 11947383.722op/s 11982546.848op/s 11999066.354op/s 12019470.340op/s 0.81% -0.793 1.261 0.37% 3119.376op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 69.070µs 69.266µs ± 0.073µs 69.260µs ± 0.045µs 69.310µs 69.382µs 69.447µs 69.479µs 0.32% 0.186 0.236 0.11% 0.005µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 14392858.125op/s 14437022.920op/s ± 15285.658op/s 14438368.381op/s ± 9404.366op/s 14445988.621op/s 14461480.928op/s 14469507.628op/s 14478135.120op/s 0.28% -0.179 0.233 0.11% 1080.859op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.832µs 6.843µs ± 0.004µs 6.843µs ± 0.002µs 6.846µs 6.851µs 6.854µs 6.857µs 0.21% 0.562 1.127 0.06% 0.000µs 1 200
credit_card/is_card_number/x371413321323331 throughput 145833403.989op/s 146124471.035op/s ± 86502.890op/s 146139089.229op/s ± 44765.567op/s 146177452.128op/s 146240043.537op/s 146338059.864op/s 146379959.522op/s 0.16% -0.557 1.122 0.06% 6116.678op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 4.268µs 4.286µs ± 0.003µs 4.286µs ± 0.001µs 4.287µs 4.290µs 4.292µs 4.293µs 0.17% -1.636 8.040 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 232937618.827op/s 233342162.952op/s ± 170513.959op/s 233339809.996op/s ± 67032.828op/s 233399107.265op/s 233619717.047op/s 233727262.241op/s 234295524.353op/s 0.41% 1.653 8.133 0.07% 12057.158op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 75.730µs 76.247µs ± 0.217µs 76.232µs ± 0.159µs 76.409µs 76.607µs 76.689µs 76.928µs 0.91% 0.102 -0.255 0.28% 0.015µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 12999183.415op/s 13115405.359op/s ± 37267.839op/s 13117771.252op/s ± 27365.549op/s 13142713.213op/s 13177490.277op/s 13197755.335op/s 13204865.993op/s 0.66% -0.088 -0.262 0.28% 2635.234op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 65.938µs 66.322µs ± 0.151µs 66.307µs ± 0.093µs 66.417µs 66.569µs 66.718µs 66.830µs 0.79% 0.405 0.335 0.23% 0.011µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 14963344.266op/s 15078067.329op/s ± 34222.979op/s 15081421.955op/s ± 21148.962op/s 15100905.300op/s 15130447.681op/s 15146188.615op/s 15165703.896op/s 0.56% -0.390 0.317 0.23% 2419.930op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 4.269µs 4.286µs ± 0.003µs 4.286µs ± 0.002µs 4.288µs 4.290µs 4.292µs 4.294µs 0.20% -0.874 4.855 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 232860717.863op/s 233316817.268op/s ± 158372.822op/s 233318536.841op/s ± 86916.357op/s 233401447.095op/s 233565266.136op/s 233696230.102op/s 234229053.736op/s 0.39% 0.886 4.919 0.07% 11198.650op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 62.444µs 63.041µs ± 0.213µs 63.024µs ± 0.135µs 63.175µs 63.393µs 63.583µs 63.649µs 0.99% 0.179 0.099 0.34% 0.015µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 15711285.466op/s 15862900.340op/s ± 53551.047op/s 15866916.688op/s ± 33913.249op/s 15897011.363op/s 15939653.682op/s 15982464.603op/s 16014444.021op/s 0.93% -0.158 0.093 0.34% 3786.631op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 69.097µs 69.267µs ± 0.073µs 69.267µs ± 0.053µs 69.320µs 69.382µs 69.421µs 69.513µs 0.36% 0.142 -0.200 0.11% 0.005µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 14385734.114op/s 14436863.999op/s ± 15275.513op/s 14436825.176op/s ± 11004.908op/s 14447758.710op/s 14461918.082op/s 14466549.290op/s 14472367.908op/s 0.25% -0.137 -0.207 0.11% 1080.142op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.835µs 6.843µs ± 0.003µs 6.842µs ± 0.001µs 6.844µs 6.848µs 6.852µs 6.853µs 0.16% 0.954 1.951 0.04% 0.000µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 145913222.153op/s 146136613.625op/s ± 59325.084op/s 146148080.894op/s ± 31388.201op/s 146172366.114op/s 146205279.474op/s 146255724.023op/s 146316101.827op/s 0.11% -0.950 1.943 0.04% 4194.917op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [4.285µs; 4.286µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/ throughput [233338740.323op/s; 233381217.445op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [98.194µs; 98.404µs] or [-0.107%; +0.107%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [10162911.002op/s; 10184431.516op/s] or [-0.106%; +0.106%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [92.926µs; 93.096µs] or [-0.091%; +0.091%] None None None
credit_card/is_card_number/ 378282246310005 throughput [10742319.002op/s; 10761460.957op/s] or [-0.089%; +0.089%] None None None
credit_card/is_card_number/37828224631 execution_time [4.285µs; 4.287µs] or [-0.014%; +0.014%] None None None
credit_card/is_card_number/37828224631 throughput [233286255.827op/s; 233353263.488op/s] or [-0.014%; +0.014%] None None None
credit_card/is_card_number/378282246310005 execution_time [83.861µs; 83.948µs] or [-0.051%; +0.051%] None None None
credit_card/is_card_number/378282246310005 throughput [11912346.826op/s; 11924574.554op/s] or [-0.051%; +0.051%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [69.256µs; 69.277µs] or [-0.015%; +0.015%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [14434904.474op/s; 14439141.365op/s] or [-0.015%; +0.015%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.843µs; 6.844µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/x371413321323331 throughput [146112482.566op/s; 146136459.504op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/ execution_time [4.285µs; 4.286µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ throughput [233318531.357op/s; 233365794.546op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [76.217µs; 76.277µs] or [-0.039%; +0.039%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [13110240.395op/s; 13120570.323op/s] or [-0.039%; +0.039%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [66.301µs; 66.343µs] or [-0.031%; +0.031%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [15073324.354op/s; 15082810.305op/s] or [-0.031%; +0.031%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [4.286µs; 4.286µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [233294868.318op/s; 233338766.218op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [63.011µs; 63.070µs] or [-0.047%; +0.047%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [15855478.680op/s; 15870322.000op/s] or [-0.047%; +0.047%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [69.257µs; 69.277µs] or [-0.015%; +0.015%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [14434746.960op/s; 14438981.038op/s] or [-0.015%; +0.015%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.843µs; 6.843µs] or [-0.006%; +0.006%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [146128391.739op/s; 146144835.511op/s] or [-0.006%; +0.006%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 00dea93 1739180223 ivoanjo/prof-11306-libdatadog16_0-ruby
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 58.661ms 58.959ms ± 0.143ms 58.936ms ± 0.075ms 59.041ms 59.167ms 59.408ms 59.733ms 1.35% 1.356 4.374 0.24% 0.010ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [58.939ms; 58.979ms] or [-0.034%; +0.034%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 00dea93 1739180223 ivoanjo/prof-11306-libdatadog16_0-ruby
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 143.543µs 144.688µs ± 0.430µs 144.690µs ± 0.136µs 144.818µs 145.110µs 145.474µs 148.876µs 2.89% 4.630 44.499 0.30% 0.030µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [144.629µs; 144.748µs] or [-0.041%; +0.041%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 00dea93 1739180223 ivoanjo/prof-11306-libdatadog16_0-ruby
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 6.252ms 6.263ms ± 0.006ms 6.262ms ± 0.003ms 6.266ms 6.274ms 6.284ms 6.299ms 0.59% 1.672 6.675 0.09% 0.000ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [6.262ms; 6.264ms] or [-0.013%; +0.013%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 00dea93 1739180223 ivoanjo/prof-11306-libdatadog16_0-ruby
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 75.896µs 76.103µs ± 0.183µs 76.092µs ± 0.057µs 76.140µs 76.215µs 76.456µs 78.341µs 2.96% 9.297 110.065 0.24% 0.013µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [76.077µs; 76.128µs] or [-0.033%; +0.033%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 00dea93 1739180223 ivoanjo/prof-11306-libdatadog16_0-ruby
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.458µs 3.347µs ± 1.484µs 3.149µs ± 0.024µs 3.173µs 3.777µs 14.556µs 15.576µs 394.61% 7.459 56.264 44.23% 0.105µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.141µs; 3.553µs] or [-6.145%; +6.145%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 00dea93 1739180223 ivoanjo/prof-11306-libdatadog16_0-ruby
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 261.695ns 273.292ns ± 16.115ns 265.308ns ± 2.134ns 271.881ns 308.747ns 322.853ns 329.792ns 24.31% 1.769 2.149 5.88% 1.139ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [271.058ns; 275.525ns] or [-0.817%; +0.817%] None None None

Baseline

Omitted due to size.

@codecov-commenter
Copy link

codecov-commenter commented Feb 7, 2025 •
edited
Loading

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 71.98%. Comparing base (b581706) to head (00dea93).

Additional details and impacted files 
@@            Coverage Diff             @@
##             main     #864      +/-   ##
==========================================
+ Coverage   71.92%   71.98%   +0.05%     
==========================================
  Files         323      323              
  Lines       48086    48086              
==========================================
+ Hits        34588    34613      +25     
+ Misses      13498    13473      -25
Components Coverage Δ
crashtracker 43.25% <ø> (+0.02%) ⬆️
crashtracker-ffi 6.30% <ø> (ø)
datadog-alloc 98.73% <ø> (ø)
data-pipeline 92.37% <ø> (ø)
data-pipeline-ffi 91.43% <ø> (ø)
ddcommon 80.08% <ø> (ø)
ddcommon-ffi 61.05% <ø> (ø)
ddtelemetry 61.74% <ø> (ø)
ddtelemetry-ffi 22.46% <ø> (ø)
dogstatsd 90.01% <ø> (ø)
dogstatsd-client 79.77% <ø> (ø)
ipc 82.68% <ø> (ø)
profiling 80.04% <ø> (+0.27%) ⬆️
profiling-ffi 70.68% <ø> (ø)
serverless 0.00% <ø> (ø)
sidecar 41.50% <ø> (ø)
sidecar-ffi 9.26% <ø> (ø)
spawn-worker 54.37% <ø> (ø)
tinybytes 92.79% <ø> (ø)
trace-mini-agent 72.48% <ø> (ø)
trace-normalization 98.23% <ø> (ø)
trace-obfuscation 95.96% <ø> (ø)
trace-protobuf 77.67% <ø> (ø)
trace-utils 94.21% <ø> (ø)

@ivoanjo ivoanjo enabled auto-merge (squash) February 7, 2025 16:39
@ivoanjo ivoanjo merged commit a85f773 into main Feb 10, 2025
31 checks passed
@ivoanjo ivoanjo deleted the ivoanjo/prof-11306-libdatadog16_0-ruby branch February 10, 2025 10:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@sanchda sanchda sanchda approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@ivoanjo @codecov-commenter @sanchda