Skip to content

Commit

Permalink
Remove unused fields in DataTrainingArguments class
Browse files Browse the repository at this point in the history
  • Loading branch information
qgallouedec committed Oct 14, 2024
1 parent 99287c2 commit 3634649
Showing 1 changed file with 0 additions and 6 deletions.
6 changes: 0 additions & 6 deletions examples/sft/train.py
Original file line number Diff line number Diff line change
Expand Up @@ -79,12 +79,6 @@ class DataTrainingArguments:
default="timdettmers/openassistant-guanaco",
metadata={"help": "The preference dataset to use."},
)
packing: Optional[bool] = field(
default=False,
metadata={"help": "Use packing dataset creating."},
)
dataset_text_field: str = field(default="text", metadata={"help": "Dataset field to use as input text."})
max_seq_length: Optional[int] = field(default=512)
append_concat_token: Optional[bool] = field(
default=False,
metadata={"help": "If True, appends `eos_token_id` at the end of each sample being packed."},
Expand Down

0 comments on commit 3634649

Please sign in to comment.