Skip to content

Commit

Permalink
Update cuda.Dockerfile
Browse files Browse the repository at this point in the history
  • Loading branch information
Smartappli authored Jul 27, 2024
1 parent 8576942 commit d098d5b
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions Docker/cuda/cuda.Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -30,13 +30,13 @@ COPY --chown=myuser:myuser . .

# Setting build-related environment variables
ENV CUDA_DOCKER_ARCH=all
ENV LLAMA_CUBLAS=1
ENV GGML_CUDA=1

# Install Python dependencies
RUN python3 -m pip install --upgrade pip pytest cmake scikit-build setuptools fastapi uvicorn sse-starlette pydantic-settings starlette-context

# Install llama-cpp-python (build with CUDA)
RUN CMAKE_ARGS="-DLLAMA_CUBLAS=on" pip install llama-cpp-python
RUN CMAKE_ARGS="-DGGML_CUDA=on" pip install llama-cpp-python

# Expose the port
EXPOSE 8008
Expand Down

0 comments on commit d098d5b

Please sign in to comment.