Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Docs9894/add new facets #27268

Merged
merged 26 commits into from
Jan 29, 2025
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
26 commits
Select commit Hold shift + click to select a range
f61e946
(DOCS-9894) Update image
buraizu Jan 23, 2025
b1fc726
(DOCS-9894) Add images
buraizu Jan 24, 2025
63229e8
(DOCS-9894) Update facets and images
buraizu Jan 24, 2025
630f7df
(DOCS-9894) Replace image
buraizu Jan 24, 2025
cbe8c6e
(DOCS-9894) Replace image
buraizu Jan 24, 2025
e9c8700
(DOCS-9894) Update facet info
buraizu Jan 24, 2025
3116e14
(DOCS-9894) Update facet info
buraizu Jan 24, 2025
3338904
(DOCS-9894) Add new images
buraizu Jan 27, 2025
29eb4e1
(DOCS-9894) Update images
buraizu Jan 27, 2025
5a283d4
(DOCS-9894) Add new images
buraizu Jan 27, 2025
b18a48e
(DOCS-9894) Update images
buraizu Jan 27, 2025
ef21d61
(DOCS-9894) Remove file from PR
buraizu Jan 27, 2025
6f01055
(DOCS-9894) Add new image
buraizu Jan 28, 2025
61a0922
(DOCS-9894) Update image
buraizu Jan 28, 2025
ce395b8
(DOCS-9894) Update steps
buraizu Jan 28, 2025
14a6151
(DOCS-9894) Remove image
buraizu Jan 28, 2025
902afcc
(DOCS-9894) Update image
buraizu Jan 28, 2025
223cc11
Update phrasing
buraizu Jan 28, 2025
e8191fb
Merge branch 'master' into docs9894/add-new-facets
buraizu Jan 29, 2025
b489eaa
Update content/en/metrics/guide/custom_metrics_governance.md
ijkaylin Jan 29, 2025
9031e0a
Merge branch 'master' into docs9894/add-new-facets
ijkaylin Jan 29, 2025
f7653b9
(DOCS-9894) Update image
buraizu Jan 29, 2025
c25fb14
(DOCS-9894) Move image
buraizu Jan 29, 2025
a227aef
(DOCS-9894) Update image locations
buraizu Jan 29, 2025
ca354e1
(DOCS-9894) Remove image
buraizu Jan 29, 2025
29d9a77
Merge branch 'master' into docs9894/add-new-facets
ijkaylin Jan 29, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
29 changes: 14 additions & 15 deletions content/en/metrics/guide/custom_metrics_governance.md
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,7 @@ further_reading:

Cloud-based applications can generate massive amounts of data and large observability costs, ultimately placing pressure on organizations to reduce this budget line item. To reduce observability costs, many teams resort to collecting fewer metrics; however, for centralized SRE and observability teams, effective custom metrics governance should increase monitoring efficiency rather than cut visibility entirely.

This guide provides best practices for managing your custom metrics volumes through the three key components of effective metrics governance: **Visibility and Attribution**, **Actionable Custom Metrics Governance**, and **Monitoring and Prevention**. Learn how to use available Datadog tools to maintain cost-effective observability for these key components. You'll learn how to:
This guide provides best practices for managing your custom metrics volumes through the three key components of effective metrics governance: **Visibility and Attribution**, **Actionable Custom Metrics Governance**, and **Monitoring and Prevention**. Learn how to use available Datadog tools to maintain cost-effective observability for these key components:
- [Find and understand your metrics usage and costs](#visibility-and-attribution)
- [Identify your largest cost drivers](#account-level-visibility)
- [Attribute your largest cost drivers to the teams or services responsible for them](#team-level-visibility-and-attribution)
Expand Down Expand Up @@ -83,7 +83,7 @@ To identify which team or service is responsible for your top custom metric name

1. From the [Plan & Usage page][2], scroll down to the *Usage Summary* section.
1. Click the **Custom Metrics** tab to view your organization's billable usage, usage trends, and top custom metrics.
1. Under the table for *Top Custom Metrics for <MONTH YEAR>*, click the icon to **See in Metrics Summary** for the top custom metric. This takes you to the *Metrics Summary* page with the opened metric details side panel.
1. Under the table for *Top Custom Metrics for <MONTH YEAR>*, click the icon to **See in Metrics Summary** for the top custom metric. This takes you to the *Metrics Summary* page with the opened metric details side panel.
1. In the side panel, scroll down to the *Tags* section to view associated tags such as teams and service.

#### View your team's custom metrics
Expand All @@ -98,15 +98,15 @@ All users in your organization can see OOTB realtime estimated custom metrics us

With Metrics Volume Management, you can identify your organization's largest metrics as well as the metric names spiking in volume (likely culprits of any unexpected overage).

{{< img src="metrics/guide/volume_management_page.png" alt="Metrics Volume Management page" style="width:90%;" >}}
{{< img src="metrics/guide/custom_metrics_governance/volume_management_page_2025-01-27.png" alt="Metrics Volume Management page" style="width:90%;" >}}

For more information, see the [Metrics Volume Management][8] documentation.

## Value-based metrics governance

Effective custom metrics governance should increase monitoring efficiency. After you understand what your usage is and attribute usage to its source, take action to reduce your metrics.

In this section, you'll learn about the actions you can take to maximize the ROI and value you get from your observability spend without sacrificing the visibility your team actively relies on.
In this section, learn about the actions you can take to maximize the ROI and value you get from your observability spend without sacrificing the visibility your team actively relies on.

### Metrics without Limits™

Expand All @@ -118,7 +118,7 @@ Reduce your indexed custom metrics volumes on any metric name by setting a tag c

With Metrics without Limits™, Datadog automatically provides the following:
- Up to date recommended tag configurations (based on our intelligent query insights) to help you maximize the ROI and value you get from your observability spend.
- Intelligent query insights that continuously compute and analyze all users' interactions (both in-app and through the API) on any metrics submitted to us so that your recommended tag configurations are always relevant.
- Intelligent query insights that continuously compute and analyze all users' interactions (both in-app and through the API) on any metrics submitted to Datadog so that your recommended tag configurations are always relevant.
- Ability to roll back changes at any time to get full visibility into all your originally submitted data.

As part of Datadog's metrics governance best practices, start by using Metrics without Limits on your [Top Custom Metrics](#identify-metrics-that-have-the-biggest-impact-on-monthly-bill).
Expand All @@ -138,18 +138,17 @@ tags:audit "Queryable tag configuration"

### Reduce costs from unqueried metrics

To ensure you're not removing valuable visibility while reducing costs, you need to differentiate between the actively queried metrics that your team relies on from the metrics that aren't queried anywhere within the Datadog platform or through the API. Datadog's intelligent query insights continuously computes and analyzes all users' interactions (in-app or via API) on any metric to help identify less valuable, unused metrics.
To ensure you're not removing valuable visibility while reducing costs, you need to differentiate between the actively queried metrics that your team relies on from the metrics that aren't queried anywhere within the Datadog platform or through the API. Datadog's intelligent query insights continuously computes and analyzes all users' interactions (in Datadog or through the API) on any metric to help identify less valuable, unused metrics.

Identify your organization's entire list of unqueried metrics over the past 30 days:
1. On the [Metrics Summary page][6], find the **Query Activity (past 30 days)** facet on the left side.
2. Select **Not Actively Queried**.
3. Find the **Configuration** facet on the left side, and select **All Tags**. The combination of these two facets provides you a list of unqueried custom metrics that haven't yet been configured that you can receive immediate cost savings from.
4. Review the resulting table of metrics names. Are there any patterns or are they submitted from a specific service? Find tags associated with these unqueried metrics.
5. (Optional) To export this list, click **Export as CSV** above the metric table.
Identify your organization's entire list of unqueried metrics over the past 30, 60, or 90 days:
1. On the [Metrics Summary page][6], find the **Query Activity** facet on the left side. Select the time frame of interest (30, 60, or 90 days).
2. Find the **Configuration** facet on the left side, and select **All Tags**. The combination of these two facets provides you a list of unqueried custom metrics that haven't yet been configured that you can receive immediate cost savings from.
3. Review the resulting table of metrics names. Are there any patterns or are they submitted from a specific service? Find tags associated with these unqueried metrics.
4. (Optional) To export this list, click **Export as CSV** above the metric table.

After you identify the metrics that your developers don't need, you can safely reduce the custom metrics volumes and reduce the costs of these unused metrics with Metrics without Limits™.
After you identify the metrics that your developers don't need, you can safely reduce the custom metrics volumes and reduce the costs of these unused metrics with Metrics without Limits™.

{{< img src="metrics/guide/custom_metrics_governance/manage_tags_fm_metrics_summary.png" alt="The Configure Metrics drop menu with the Manage tags selection highlighted" style="width:90%;" >}}
{{< img src="metrics/guide/custom_metrics_governance/manage_tags_fm_metrics_summary_2025-01-27.png" alt="The Configure Metrics drop menu with the Manage tags selection highlighted" style="width:90%;" >}}

5. At the top of the [Metrics Summary page][6], click the **Configure Metrics** dropdown menu.
6. Select **Manage tags** to open the [Metrics without Limits™ Tag configuration modal][13] to configure multiple metrics in bulk.
Expand All @@ -164,7 +163,7 @@ Even though a metric is not queried for the past 30 days, your teams might still

Datadog's Metrics without Limits™ is a suite of features that also provide you with OOTB insights to assess the value of your actively queried metrics with [Metrics Related Assets][15]. A metrics related asset refers to any Datadog asset, such as a dashboard, notebook, monitor, or SLO that queries a particular metric. Use related asset popularity and quantity to evaluate metric utility within your organization, enabling data-driven decisions. Gain a better understanding of how your team can use existing metrics to get more value from your observability spend.

{{< img src="metrics/volume/related_assets.png" alt="Metric detail side panel showing the Related Assets section. The example metric is applied to one dashboard" style="width:100%;" >}}
{{< img src="metrics/related_assets_2025-01-27.png" alt="Metric detail side panel showing the Related Assets section. The example metric is applied to three dashboards" style="width:100%;" >}}

To view a metric's related assets:
1. Click on the metric name to open its details side panel.
Expand Down
22 changes: 10 additions & 12 deletions content/en/metrics/summary.md
Original file line number Diff line number Diff line change
Expand Up @@ -19,27 +19,26 @@ The [Metrics Summary page][1] displays a list of your metrics reported to Datado

Search your metrics by metric name or tag using the **Metric** or **Tag** search fields:

{{< img src="metrics/summary/tag_advancedfiltering3.mp4" alt="The metrics summary page with NOT team:* entered in the Tag search bar" video=true style="width:75%;">}}
{{< img src="metrics/summary/tag_advanced_filtering.png" alt="The metrics summary page with NOT team:* entered in the Tag search bar" style="width:75%;">}}

Tag filtering supports boolean and wildcard syntax so that you can quickly identify:
Tag filtering supports Boolean and wildcard syntax so that you can identify:
* Metrics that are tagged with a particular tag key, for example, `team`: `team:*`
* Metrics that are missing a particular tag key, for example, `team`: `NOT team:*`


## Facet panel

The search bars provide the most comprehensive set of actions to filter the list of metrics. But facets can also filter your metrics by:

- **Configuration**: Metrics with tag configurations
- **Percentiles**: Distribution metrics enabled by percentiles/advanced query capabilities
- **Historical Metrics**: Metrics that have historical metrics ingestion enabled
- **Query Activity** (Beta): Metrics not queried in the app or by the API in the past 30 days
- **Query Activity**: Metrics not queried in Datadog or by the API in the past 30, 60, or 90 days
- **Metric Type**: Differentiate between distribution and non-distribution metrics (counts, gauges, rates)
- **Metric Origin**: The product from which the metric originated (for example, metrics generated from Logs or APM Spans). To learn more about the different metric origin types, see [Metric origin definitions][12].

**Note**: A metric included on a Dashboard that has not been loaded by a user in the last 30 days would not be considered actively queried.
**Note**: A metric included on a Dashboard that has not been loaded by a user in the last 30 days is not considered actively queried.

{{< img src="metrics/summary/facets4.png" alt="Metrics Facet Panel" style="width:75%;">}}
{{< img src="metrics/summary/facet_panel.png" alt="Metrics Facet Panel" style="width:75%;">}}

## Configuration of multiple metrics

Expand All @@ -53,7 +52,7 @@ Clicking on **Configure Metrics** gives you multiple options that you can use to

* **Enable or disable percentiles**: Manage percentile aggregations across multiple distribution metrics. See the [Distributions page][31] for more information.

{{< img src="metrics/summary/percentile_aggregations_toggle.png" alt="Toggle to manage percentile aggregations" style="width:100%;">}}
{{< img src="metrics/summary/percentile_aggregations_toggle_2025-01-28.png" alt="Toggle to manage percentile aggregations" style="width:100%;">}}

* **Enable or disable historical metrics ingestion**: Manage the ingestion of historical metric data. See the [Historical Metrics Ingestion page][30] for more information.

Expand Down Expand Up @@ -139,15 +138,15 @@ For any particular tag key, you can:

[Learn more about tagging][5].

## Metrics Related Assets
### Metrics Related Assets

{{< img src="metrics/summary/related_assets_dashboards.png" alt="Related Assets for a specified metrics name" style="width:80%;">}}

To determine the value of any metric name to your organization, use Metrics Related Assets. Metrics related assets refers to any dashboard, notebook, monitor, or SLO that queries a particular metric.

1. Scroll to the bottom of the metric's details side panel to the "Related Assets" section.
2. Click the dropdown button to view the type of related asset you are interested in (dashboards, monitors, notebooks, SLOs). You can additionally leverage the search bar to validate specific assets.

1. Scroll to the bottom of the metric's details side panel to the **Related Assets** section.
2. Click the dropdown button to view the type of related asset you are interested in (dashboards, monitors, notebooks, SLOs). You can additionally use the search bar to validate specific assets.
## Custom Metrics Tags Cardinality Explorer

{{< callout url="https://forms.gle/H3dG9tTdR6bqzHAX9" >}}
Expand All @@ -168,7 +167,6 @@ You can configure tags using the bulk metric tag configuration button or the **M

1. Click on your custom distribution metric name in the **Metrics Summary** table to open the metrics details side panel.
2. Click the **Manage Tags** button to open the tag configuration modal.

3. Select **Include tags...** or **Exclude tags...** to customize the tags you do or don't want to query for. For more information on tag configuration, see the [Metrics without Limits][10] documentation.
4. Preview the effects of your proposed tag configuration with the cardinality estimator before selecting **Save**.

Expand Down
Loading
Loading