chore(benchmarks): combine ddtrace-run and startup benchmarks (#13391)

ddtrace-run benchmarks are broken, this PR removes this benchmarking
scenario and combines it with the new `startup` scenario.

Issues with ddtrace-run benchmarks:
- telemetry variants do not enable/disable the generation of telemetry
events. To record a telemetry event on application start up
`_DD_INSTRUMENTATION_TELEMETRY_TESTS_FORCE_APP_STARTED` must be set to
true. Otherwise telemetry events will be recorded 10 seconds after
ddtrace instrumentation is applied
- http proxy does not mock tracer-agent connections. We set the trace
api version to v0.4 but then mock requests to the v0.5 endpoint. This
does not make sense.
- ddtrace-run benchmarks do not mock statsd connections. So the baseline
that attempts to disable all http/udp/unix connections is inaccurate

## Checklist
- [ ] PR author has checked that all the criteria below are met
- The PR description includes an overview of the change
- The PR description articulates the motivation for the change
- The change includes tests OR the PR description describes a testing
strategy
- The PR description notes risks associated with the change, if any
- Newly-added code is easy to change
- The change follows the [library release note
guidelines](https://ddtrace.readthedocs.io/en/stable/releasenotes.html)
- The change includes or references documentation updates if necessary
- Backport labels are set (if
[applicable](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting))

## Reviewer Checklist
- [ ] Reviewer has checked that all the criteria below are met 
- Title is accurate
- All changes are related to the pull request's stated goal
- Avoids breaking
[API](https://ddtrace.readthedocs.io/en/stable/versioning.html#interfaces)
changes
- Testing strategy adequately addresses listed risks
- Newly-added code is easy to change
- Release note makes sense to a user of the library
- If necessary, author has acknowledged and discussed the performance
implications of this PR as reported in the benchmarks PR comment
- Backport labels are set in a manner that is consistent with the
[release branch maintenance
policy](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting)

Author: mabdinur

.gitlab/benchmarks/microbenchmarks.yml

@@ -163,7 +163,6 @@ microbenchmarks:
         - "packages_update_imported_dependencies"
         - "telemetry_add_metric"
         - "startup"
-        - "ddtrace_run"
 
 "microbenchmarks flaky":
   extends: .benchmarks

benchmarks/ddtrace_run/config.yaml

@@ -1,5 +1,7 @@
 baseline: &defaults
   env: {}
+  ddtrace_run: false
+  send_span: false
   import_ddtrace: false
   import_ddtrace_auto: false
   import_flask: false
@@ -32,3 +34,29 @@ import_ddtrace_auto_django:
   <<: *defaults
   import_ddtrace_auto: true
   import_django: true
+ddtrace_run:
+  <<: *defaults
+  ddtrace_run: true
+ddtrace_run_appsec:
+  <<: *defaults
+  env: {"DD_APPSEC_ENABLED": "true"}
+  ddtrace_run: true
+ddtrace_run_profiling:
+  <<: *defaults
+  env: {"DD_PROFILING_ENABLED": "true"}
+  ddtrace_run: true
+ddtrace_run_telemetry_enabled:
+  <<: *defaults
+  env: {"_DD_INSTRUMENTATION_TELEMETRY_TESTS_FORCE_APP_STARTED": "true"}
+  ddtrace_run: true
+ddtrace_run_telemetry_disabled:
+  <<: *defaults
+  env: {"DD_INSTRUMENTATION_TELEMETRY_ENABLED": "false", "_DD_INSTRUMENTATION_TELEMETRY_TESTS_FORCE_APP_STARTED": "false"}
+  ddtrace_run: true
+ddtrace_run_send_span:
+  <<: *defaults
+  send_span: true
+ddtrace_run_runtime_metrics:
+  <<: *defaults
+  env: {"DD_RUNTIME_METRICS_ENABLED": "true"}
+  ddtrace_run: true

benchmarks/ddtrace_run/scenario.py

@@ -8,8 +8,10 @@
 class Startup(bm.Scenario):
     import_ddtrace: bool
     import_ddtrace_auto: bool
+    ddtrace_run: bool
     import_flask: bool
     import_django: bool
+    send_span: bool
     env: str
 
     def run(self):
@@ -33,8 +35,15 @@ def run(self):
             # `import django` doesn't really do anything, `django.core.management` is what `manage.py` uses
             commands.append("import django.core.management")
 
+        if self.send_span:
+            commands.append("from ddtrace.trace import tracer")
+            commands.append("tracer.trace('test-x', service='bench-test').finish()")
+
         args = ["python", "-c"] + [";".join(commands)]
 
+        if self.ddtrace_run:
+            args = ["ddtrace-run"] + args
+
         def _(loops: int):
             for _ in range(loops):
                 subprocess.check_call(args=args, env=env)