Skip to content

Pull requests: huggingface/trl

New pull request New
75 Open 1,758 Closed
75 Open 1,758 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Adding support for different losses which are now supported by Liger
#3815 opened Jul 31, 2025 by Manan17 Loading…
1 of 5 tasks
fix CI docs and grpo slow test
#3814 opened Jul 30, 2025 by kashif Loading…
3
Performance optimization: Replace list comprehensions with tensor operations in BCO and KTO trainers
#3813 opened Jul 30, 2025 by chi2liu Loading…
5 tasks
1
Add GSPO script examples (VLM/LLM)
#3810 opened Jul 30, 2025 by sergiopaniego Loading…
5 tasks
5
Add soft overlong punishment reward function and update documentation
#3804 opened Jul 30, 2025 by qgallouedec Loading…
5 tasks
Rloo final
#3801 opened Jul 29, 2025 by shirinyamani Loading…
5 tasks
1
add xpu support for mergekit
#3800 opened Jul 29, 2025 by yao-matrix Loading…
1
GSPO parameters update from v2
#3798 opened Jul 29, 2025 by BounharAbdelaziz Loading…
3 tasks
7
Add dataset mixer
#3791 opened Jul 28, 2025 by lewtun Loading…
1 of 5 tasks
2
[GRPO] update transformer version for CB
#3786 opened Jul 28, 2025 by kashif Loading…
7
Add vLLM server mode support to OnlineDPOTrainer
#3783 opened Jul 27, 2025 by vaelev Loading…
6 tasks done
1
Add AlphaPO Trainer
#3776 opened Jul 26, 2025 by qingquansong Loading…
3 of 5 tasks
6
change doc for num_iterations and steps_per_generation to hopefully make them more clear and differentiate between them more clearly
#3761 opened Jul 23, 2025 by avishaiElmakies Loading…
2 of 5 tasks
1
3
Dynamic sampling option in GRPO trainer based on DAPO paper
#3758 opened Jul 23, 2025 by almeidava93 Loading…
2 of 5 tasks
1
10
Support dLLM in GRPO reference model creation
#3743 opened Jul 18, 2025 by xijia-tao Loading…
1
3
Add basic support for FSDP/Lora when using TRL/VLLM
#3735 opened Jul 14, 2025 by ojh31 Loading…
5 tasks
2
Add warn0 utility and replace warnings.warn with rank-aware warnings in trainer
#3734 opened Jul 14, 2025 by yafshar Loading…
1 of 5 tasks
2
[WIP] Fix ppo example accelerator initialization error
#3732 opened Jul 14, 2025 by ccs96307 • Draft
2 of 5 tasks
[SFT] Dry up the sft tests
#3657 opened Jun 27, 2025 by kashif Loading…
5 tasks
1
feat: Initial implementation of RePO trainer and components
#3655 opened Jun 26, 2025 by celsowm Loading…
5 tasks
2
Ensure Chat Template Safe Prompt Truncation
#3646 opened Jun 25, 2025 by pramodith Loading…
4 of 5 tasks
21
[WIP] vllm-server-spec-dec-support
#3643 opened Jun 24, 2025 by shirinyamani Loading…
5 tasks
1
GRPO: Pack Responses within the same group.
#3642 opened Jun 24, 2025 by pramodith • Draft
4 of 5 tasks
1
Add Entropy Control to GRPOTrainer
#3628 opened Jun 22, 2025 by 1485840691 Loading…
35
Feature: Add SGLang support for GRPO Trainer
#3627 opened Jun 21, 2025 by PrinsYin • Draft
5 tasks
5
ProTip! Adding no:label will show everything without a label.