Skip to content

Commit f64cc9e

Browse files
committed
Add pynvml package to final image
1 parent 39788c4 commit f64cc9e

File tree

1 file changed

+3
-0
lines changed

1 file changed

+3
-0
lines changed

Dockerfile

+3
Original file line numberDiff line numberDiff line change
@@ -109,6 +109,9 @@ COPY --from=build-xformers /wheels/* wheels/
109109
RUN uv pip install wheels/*
110110
RUN rm -r wheels
111111

112+
# Install pynvml
113+
RUN uv pip install pynvml
114+
112115
# Add additional packages for vLLM OpenAI
113116
RUN uv pip install accelerate hf_transfer modelscope bitsandbytes timm boto3 runai-model-streamer runai-model-streamer[s3] tensorizer
114117

0 commit comments

Comments
 (0)