Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a confirmation message before submitting a fine-tuning job #190

Merged
merged 5 commits into from
Sep 24, 2024

Conversation

mryab
Copy link
Member

@mryab mryab commented Sep 24, 2024

This PR adds a confirmation message before submitting a fine-tuning job via CLI to communicate the pricing model to the users. Users can skip this message when they submit a job with -y or --confirm in the set of arguments.

Example output:

poetry run together fine-tuning create --training-file $FILE_NAME --model meta-llama/Meta-Llama-3-70B-Instruct --n-epochs 3 --n-checkpoints 3 --no-lora --batch-size 16 --wandb-api-key $WANDB_KEY  --suffix llama3_70b_full
You are about to launch a fine-tuning job. The cost of your job will be determined by the model size, the number of tokens in the training file, the number of tokens in the validation file, the number of epochs, and the number of evaluations. Visit https://www.together.ai/pricing to get a price estimate.
You can add `-y` or `--confirm` to skip this message.

Do you want to proceed? [Y/n]:

If the user presses Enter, the job proceeds automatically.

If the user declines:

You are about to launch a fine-tuning job. The cost of your job will be determined by the model size, the number of tokens in the training file, the number of tokens in the validation file, the number of epochs, and the number of evaluations. Visit https://www.together.ai/pricing to get a price estimate.
You can add `-y` or `--confirm` to skip this message.

Do you want to proceed? [Y/n]: n
No confirmation received, stopping job launch

If the user passes -y, the job proceeds automatically:

poetry run together fine-tuning create --training-file $FILE_NAME --model meta-llama/Meta-Llama-3-70B-Instruct --n-epochs 3 --n-checkpoints 3 --no-lora --batch-size 16 --wandb-api-key $WANDB_KEY   --suffix llama3_70b_full -y
message='The default value of batch size has been changed from 32 to 16 since together version >= 1.2.6'

Fixes ENG-10379

@mryab mryab force-pushed the eng10379_add_ft_confirmation branch from 77a3e39 to b6a30b6 Compare September 24, 2024 19:06
@orangetin orangetin merged commit 2a3fec6 into main Sep 24, 2024
13 checks passed
@mryab mryab deleted the eng10379_add_ft_confirmation branch September 24, 2024 19:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants