Add Direct Preference Optimization support
Open
- Dominant language
- Python
- Stars
- 193
- Forks
- 8
- PR merge metrics
- No merged PRs in 30d
Description
There should be a way to do Direct Preference Optimization with diffusion models. Ryan Murdock already has it working:
https://twitter.com/advadnoun/status/1677479082752364546
Requires further investigation.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.