Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

For finetuning, add an alternative to LlamaFactory #134

Open
wants to merge 2 commits into
base: main
Choose a base branch
from
Open

For finetuning, add an alternative to LlamaFactory #134

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
8030718
add an alternative to LlamaFactory
Sep 6, 2024
42ae167
refine wording
Sep 13, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1368,6 +1368,8 @@ hyperparameters. One argument to note is ``cutoff_len``, which is the
maximum length of the training data. Control this parameter to avoid OOM
error.

**Note:** For finetuning Qwen2-VL, in case you prefer a lightweight way, e.g. you would like to write your own "train loop". Here is an alternative repo for reference: [Qwen2-VL-Finetuning](https://github.com/zhangfaen/finetune-Qwen2-VL) . There are about 200 lines of effective code for preparing dataset, dataloader, train loop, etc. It is simple and straight forward. It supports flash_attention2 and distributed training.

## Function Calling

Qwen2-VL supports Function Calling (aka. Tool Calling or Tool Use). For details on how to use this capability, please refer to the Qwen-Agent project for [the function calling example](https://github.com/QwenLM/Qwen-Agent/blob/main/examples/qwen2vl_function_calling.py) and [the agent example](https://github.com/QwenLM/Qwen-Agent/blob/main/examples/qwen2vl_assistant_tooluse.py).
Expand Down