Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Optimize the image building script #29

Open
wants to merge 6 commits into
base: main
Choose a base branch
from
Open

Optimize the image building script #29

wants to merge 6 commits into from
+10 −5

Conversation

anw90
Copy link
Contributor

@anw90 anw90 commented Oct 23, 2024 •
edited
Loading

  1. The base image now includes Bazel 6.10, which is required by BladeDISC.
  2. The image build time has been changed to 1:00 AM.
  3. By reusing the previous build cache, the compilation time has been reduced from approximately 70 minutes to around 30 minutes.

yitongh
yitongh reviewed Oct 23, 2024
View reviewed changes
docker/Dockerfile.release
@@ -9,6 +9,7 @@ ENV PROXY=${use_proxy:+'https_proxy=http://127.0.0.1:7890 http_proxy=http://127.

COPY ./whls/* ${work_dir}/
RUN cd ${work_dir} \
&& env ${PROXY} pip install *.whl transformers==4.33.0 datasets pillow SentencePiece accelerate transformers_stream_generator tiktoken peft bitsandbytes scipy \
&& env ${PROXY} pip install *.whl \
&& env ${PROXY} pip install transformers==4.33.0 datasets pillow SentencePiece accelerate transformers_stream_generator tiktoken peft bitsandbytes scipy \
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Update transformers to higher version for llama3？

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@yitongh yitongh yitongh left review comments

@Seventeen17 Seventeen17 Awaiting requested review from Seventeen17

@eedalong eedalong Awaiting requested review from eedalong

@lausannel lausannel Awaiting requested review from lausannel

@baoleai baoleai Awaiting requested review from baoleai

@hanwen-sun hanwen-sun Awaiting requested review from hanwen-sun

@Yancey1989 Yancey1989 Awaiting requested review from Yancey1989

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@anw90 @yitongh