Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Containers that use cuda images in k8s do not have gpu resources, but the process id can be seen using nvidia-smi #954

Open
ZYWNB666 opened this issue Sep 12, 2024 · 3 comments
Labels
lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale.

Comments

@ZYWNB666
Copy link

1、The container used is " tensorflow/tensorflow:2.16.1-gpu "
2、There is no configuration for the gpu application in the yaml file
Image

3、You can see the pod pid in the nvidia-smi command
It seems that this pod will be displayed on all free graphics cards, I don't use any gpu virtualization tools, I don't know if it takes up this video card
Image

@ZYWNB666 ZYWNB666 changed the title The cuda container does not apply for gpu resources, but the pid can be found using nvidia-smi Containers that use cuda images in k8s do not have gpu resources, but the process id can be seen using nvidia-smi Sep 12, 2024
@ZYWNB666
Copy link
Author

@klueska Dude, do you have time to look at my problem?

@ZYWNB666
Copy link
Author

@elezar Dude, do you have time to look at my problem?

Copy link

This issue is stale because it has been open 90 days with no activity. This issue will be closed in 30 days unless new comments are made or the stale label is removed.

@github-actions github-actions bot added the lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. label Dec 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale.
Projects
None yet
Development

No branches or pull requests

1 participant