Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Optimize the image building script #29

Open
wants to merge 6 commits into
base: main
Choose a base branch
from
+10 −5
Open

Optimize the image building script #29

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
8bcaa3c
Install Bazel 6.1.0 for BladeDISC in Dockerfile
anw90 Oct 17, 2024
00343f4
update image building time
anw90 Oct 18, 2024
dc81936
optimize
anw90 Oct 22, 2024
c1b30de
Update fa version
anw90 Oct 23, 2024
b442e90
update fa
anw90 Oct 23, 2024
6a98c47
update building time
anw90 Oct 23, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions .github/workflows/build_image.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,8 +3,8 @@ name: Daily Image Building Script Execution
on:
workflow_dispatch:
schedule:
# Runs at 1:00 AM every day
- cron: '0 1 * * *'
# Runs daily at 1:00 AM, Beijing time.
- cron: '0 17 * * *' # This is UTC time

jobs:
run-shell-script:
Expand Down
3 changes: 3 additions & 0 deletions docker/Dockerfile.base
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -67,6 +67,9 @@ RUN env ${PROXY} curl -L -O "http://github.com/bazelbuild/bazel/releases/downloa
&& ./"$bazel_file" --user \
&& rm -f "$bazel_file"

# install bazel 6.1.0 for BladeDISC
RUN cd "/root/.bazel/bin" && env ${PROXY} curl -fLO https://releases.bazel.build/6.1.0/release/bazel-6.1.0-linux-x86_64 && chmod +x bazel-6.1.0-linux-x86_64

ENV PATH "/root/bin:$PATH"
ENV TERM xterm

Expand Down
3 changes: 2 additions & 1 deletion docker/Dockerfile.release
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,7 @@ ENV PROXY=${use_proxy:+'https_proxy=http://127.0.0.1:7890 http_proxy=http://127.

COPY ./whls/* ${work_dir}/
RUN cd ${work_dir} \
&& env ${PROXY} pip install *.whl transformers==4.33.0 datasets pillow SentencePiece accelerate transformers_stream_generator tiktoken peft bitsandbytes scipy \
&& env ${PROXY} pip install *.whl \
&& env ${PROXY} pip install transformers==4.33.0 datasets pillow SentencePiece accelerate transformers_stream_generator tiktoken peft bitsandbytes scipy \
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Update transformers to higher version for llama3？

&& env ${PROXY} pip install torchvision==0.18.0 --no-deps \
&& rm -rf ${work_dir}/* /root/.cache/pip
5 changes: 3 additions & 2 deletions docker/build_whls.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -34,7 +34,6 @@ function build_pytorch {

function build_torch_xla {
pushd pytorch/xla
python setup.py clean
env ${proxy} TF_CUDA_COMPUTE_CAPABILITIES="${cuda_compute_capabilities//\ /,}" \
TORCH_CUDA_ARCH_LIST="${cuda_compute_capabilities}" \
BUILD_CPP_TESTS=0 \
Expand All @@ -50,7 +49,9 @@ function build_torch_xla {
python setup.py ${build_mode}
if [ "${build_mode}" = "bdist_wheel" ]; then
cp dist/*.whl ${work_dir}/whls/
cp third_party/flash-attention/dist/*.whl ${work_dir}/whls/
# TODO: Directly installing FlashAttention 2.5.6 via `pip install` can cause an torch related undefined symbol error.
# Install FlashAttention in the Dockerfile.release after torchacc adapts FA to version 2.5.8.
wget https://odps-release.oss-cn-zhangjiakou.aliyuncs.com/torchacc/whls/flash_attn-2.5.6-cp310-cp310-linux_x86_64.whl -P ${work_dir}/whls/
fi
popd
}
Expand Down
Loading