Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore(datadog_agent source, datadog_metrics sink): Add end to end tests with the Datadog Agent for metrics. #18840

Merged
merged 72 commits into from
Jan 31, 2024

Conversation

neuronull
Copy link
Contributor

@neuronull neuronull commented Oct 13, 2023

Adds end-to-end tests with the Datadog Agent for the datadog_agent source and datadog_metrics sink.

This is an extension of #18538

The validation of metrics is more complex than logs.

The validation done is dependent on metric type. In all cases, we can't rely on the timestamps being the same.

Of note: in vector we currently still send to the v1 endpoint. Once we convert to the v2 endpoint, some logic here can be removed which is converting the v1 JSON response into the protobuf response. Additionally the JSON response structs were required to be made visible to the e2e module.

closes: #18535
epic: #18533

…nto neuronull/sink_datadog_metrics_v2_series_endpoint_conversion
…nto neuronull/sink_datadog_metrics_v2_series_endpoint_conversion
19, 11, 6, 17, 5, 0, 1, 17, 17
]

for i in range(50):
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The framework in this PR is the bulk of the changes ... if anyone has suggestions on additional test cases to cover, that would be helpful. In theory the framework should hold up and we would just need to extend this code.

@neuronull neuronull requested a review from bruceg January 17, 2024 19:32
Copy link
Member

@bruceg bruceg left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A lot of suggestions below, but nothing really blocking given that this is just tests.

tests/e2e/datadog/logs/mod.rs Outdated Show resolved Hide resolved
tests/e2e/datadog/metrics/mod.rs Outdated Show resolved Hide resolved
tests/e2e/datadog/metrics/series.rs Outdated Show resolved Hide resolved
tests/e2e/datadog/metrics/series.rs Outdated Show resolved Hide resolved
tests/e2e/datadog/metrics/series.rs Outdated Show resolved Hide resolved
tests/e2e/datadog/metrics/series.rs Outdated Show resolved Hide resolved
tests/e2e/datadog/metrics/series.rs Outdated Show resolved Hide resolved
tests/e2e/datadog/metrics/series.rs Outdated Show resolved Hide resolved
tests/e2e/datadog/metrics/sketches.rs Outdated Show resolved Hide resolved
@neuronull neuronull requested a review from dsmith3197 January 29, 2024 15:12
Copy link
Contributor

@dsmith3197 dsmith3197 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks good to me at a high level

@github-actions github-actions bot added the domain: vdev Anything related to the vdev tooling label Jan 30, 2024
@neuronull neuronull merged commit 5933c06 into neuronull/dd_e2e_infra_logs Jan 31, 2024
49 checks passed
@neuronull neuronull deleted the neuronull/dd_e2e_metrics branch January 31, 2024 15:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
domain: ci Anything related to Vector's CI environment domain: vdev Anything related to the vdev tooling no-changelog Changes in this PR do not need user-facing explanations in the release changelog sink: datadog_metrics Anything `datadog_metrics` sink related source: datadog_agent Anything `datadog_agent` source related
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants