Skip to content

litellm full instrumentation poc #13407

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 7 commits into
base: main
Choose a base branch
from
Draft

Conversation

ncybul
Copy link
Contributor

@ncybul ncybul commented May 13, 2025

No description provided.

Copy link
Contributor

CODEOWNERS have been resolved as:

releasenotes/notes/litellm-proxy-tracing-920209d5d51a231b.yaml          @DataDog/apm-python
tests/snapshots/tests.contrib.litellm.test_litellm.test_litellm_route_request.json  @DataDog/apm-python
ddtrace/contrib/_litellm.py                                             @DataDog/apm-core-python @DataDog/apm-idm-python
ddtrace/contrib/internal/litellm/patch.py                               @DataDog/apm-core-python @DataDog/apm-idm-python
ddtrace/llmobs/_integrations/litellm.py                                 @DataDog/ml-observability
ddtrace/llmobs/_integrations/utils.py                                   @DataDog/ml-observability
riotfile.py                                                             @DataDog/apm-python
tests/contrib/litellm/test_litellm.py                                   @DataDog/apm-core-python @DataDog/apm-idm-python
.riot/requirements/143130b.txt                                          @DataDog/apm-python
.riot/requirements/3bb416c.txt                                          @DataDog/apm-python
.riot/requirements/6770e54.txt                                          @DataDog/apm-python
.riot/requirements/739c736.txt                                          @DataDog/apm-python
.riot/requirements/d016adf.txt                                          @DataDog/apm-python

Copy link
Contributor

Bootstrap import analysis

Comparison of import times between this PR and base.

Summary

The average import time from this PR is: 232 ± 2 ms.

The average import time from base is: 233 ± 2 ms.

The import time difference between this PR and base is: -1.4 ± 0.1 ms.

Import time breakdown

The following import paths have shrunk:

ddtrace.auto 1.858 ms (0.80%)
ddtrace.bootstrap.sitecustomize 1.190 ms (0.51%)
ddtrace.bootstrap.preload 1.190 ms (0.51%)
ddtrace.internal.remoteconfig.client 0.609 ms (0.26%)
ddtrace 0.667 ms (0.29%)

@pr-commenter
Copy link

pr-commenter bot commented May 13, 2025

Benchmarks

Benchmark execution time: 2025-05-13 20:21:12

Comparing candidate commit 8079ce5 in PR branch nicole-cybul/litellm-poc with baseline commit 690973d in branch main.

Found 0 performance improvements and 1 performance regressions! Performance is the same for 526 metrics, 9 unstable metrics.

scenario:iast_aspects-translate_aspect

  • 🟥 execution_time [+251.497ns; +302.563ns] or [+7.427%; +8.935%]

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant