Skip to content
This repository has been archived by the owner on Aug 28, 2024. It is now read-only.

notebooks should not have ephemeral storage limit #246

Open
samos123 opened this issue Oct 7, 2023 · 1 comment
Open

notebooks should not have ephemeral storage limit #246

samos123 opened this issue Oct 7, 2023 · 1 comment
Assignees
@samos123

Comments

@samos123
Copy link
Contributor

samos123 commented Oct 7, 2023 

  Warning  Evicted              60s                kubelet            Pod ephemeral local storage usage exceeds the total limit of containers 100Gi.

This can be frustating because in many cases the node had more than 100Gi ephemeral storage available and I lose all my notebook progress when this happens
@samos123 samos123 self-assigned this Oct 7, 2023
@samos123
Copy link
Contributor Author

This turned out to be a K8s bug that if one of the sidecars sets a limit then all containers inherit that limit

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@samos123 samos123

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@samos123