Buffering per service without Kafka #21664
Unanswered
brycefisher
asked this question in
Q&A
Replies: 1 comment
-
I think that might be possible using the throttle transform. That transform can be used to limit the number of events per time window for a given key. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I'm interested in whether vector might be a good fit for my use case -- I have an existing solution, but it doesn't seem to solve a specific problem I have. I have a kubernetes cluster using the prometheus operator to scrape metrics from many different workloads. Unfortunately, if a single Deployment or other workload begins to create many pods rapidly, this can produce too many series for my metrics sink.
In my current solution, I don't have a good way to proactively limit the number of cumulative series from a single ServiceMonitor (all pods from a Deployment, for example). And no single pod produces so many metrics that I can use prometheus
scrape_config.label_limits
.If I used vector without kafka as described in the docs, would it be possible to have vector drop metrics from a single ServiceMonitor based on the cumulative cardinality of that service monitor?
Beta Was this translation helpful? Give feedback.
All reactions