Skip to content

Commit

Permalink
Update cuda.Dockerfile
Browse files Browse the repository at this point in the history
  • Loading branch information
Smartappli authored Jul 27, 2024
1 parent 23cfad5 commit feb901e
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion Docker/cuda/cuda.Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,7 @@ RUN python3 -m venv venv
# RUN python3 -m pip install --upgrade pip pytest cmake scikit-build setuptools fastapi uvicorn sse-starlette pydantic-settings starlette-context

# Install llama-cpp-python (build with cuda)
RUN CMAKE_ARGS="-DGGML_CUDA=on" venv/bin/pip install .[server]
RUN CMAKE_ARGS="-DGGML_CUDA=on" venv/bin/pip install llama-cpp-python[server]

# RUN make clean
FROM nvidia/cuda:${CUDA_RUNTIME_IMAGE} as runtime
Expand Down

0 comments on commit feb901e

Please sign in to comment.