关于fault_tolerance_data_collator的labels处理 #590
Unanswered
sysuprophet
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
预训练脚本run_clm_pt_with_peft.py中，def group_texts(examples)函数中使用的是result["labels"] = result["input_ids"].copy()，但是到了trainer的data_collator函数fault_tolerance_data_collator中，使用的却是lable和label_ids，这两个对不上呀，数据能被正常处理吗？（labels VS label/label_ids）
Beta Was this translation helpful? Give feedback.
All reactions