Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Split large result sets into time-chunked queries #5

Open
bcelenza opened this issue Nov 11, 2021 · 0 comments
Open

Split large result sets into time-chunked queries #5

bcelenza opened this issue Nov 11, 2021 · 0 comments
Labels
enhancement New feature or request

Comments

@bcelenza
Copy link
Owner

bcelenza commented Nov 11, 2021

Occasionally you need to write a query and get all the results across a long time span (say a month). Performing a single search for that period may return a truncated list of results capped at the maximum returned by CloudWatch (default: 1000, up to 10000 with limit).

It would be great to at least specify a flag that would split the query up into time chunks that could allow combination of all results in the full period.

So a command like:

cwq --log-group MyLogGroup --start 1y --interval 1d '....'

Would search a log group for an entire year, but in successive (or potentially parallel) one day chunks, combining all the results at the end.

@bcelenza bcelenza added the enhancement New feature or request label Nov 19, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant