Skip to content

Commit

Permalink
llama.cpp-base: compile just the binaries we need due to github runne…
Browse files Browse the repository at this point in the history
…r disk space
  • Loading branch information
gilbertgong committed Nov 1, 2024
1 parent fd636b8 commit 2bd0845
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion llama.cpp-base/Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -34,7 +34,7 @@ ENV LLAMA_CURL=1
ENV LLAMA_CUDA_FA_ALL_QUANTS=1
ENV GGML_CUDA_FA_ALL_QUANTS=1

RUN make -j 12
RUN make -j 12 llama-batched-bench llama-server

FROM ${CUDA_BASE_CONTAINER} as runtime

Expand Down

0 comments on commit 2bd0845

Please sign in to comment.