Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix kit infras timeouts and block device mappings #283

Merged
merged 1 commit into from
Aug 30, 2022

Conversation

bwagner5
Copy link
Contributor

Issue #, if available:
N/A

Description of changes:

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

@bwagner5 bwagner5 requested a review from prateekgogia August 30, 2022 19:24
blockDeviceMappings:
- deviceName: /dev/xvda
ebs:
volumeSize: 100Gi
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

do we really need this much memory ? Thinking in terms of Frugality principle for customers using this Infra.

What's causing disks to fill up ? If it's logs, we should probably have the CW logging enabled so we rotate the logs on the instances so disks won't fill up.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

100Gi is still pretty small. This is a mixture of container images that are pulled and logs for tests. We'll definitely rotate logs soon so that we don't breach this limit, but I think 100Gi is still pretty frugal but much more reasonable for the type of work the nodes are facilitating.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ok, we can go ahead with this change for now but we should be addressing the root of the problem before we increase it further in future.
My concern was that 100Gi won't be enough if root of the problem is not addressed. If it's log rotation, that should be addressed is what I was trying to convey. I had a backlog ticket cut for this in the past - #279 which should help flushing logs from nodes to CW.

@hakuna-matatah
Copy link
Contributor

LGTM!

@bwagner5 bwagner5 merged commit 3a171c8 into awslabs:main Aug 30, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants