Skip to content

direct preference optimization with only 1 model copy :)

Notifications You must be signed in to change notification settings

VonRosenchild/dpo-lora

 
 

About

direct preference optimization with only 1 model copy :)

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%