[Feature Request] Add Support for FQL
Open
@neuriv is already working on this.
Since Sep 19, 2026.
enhancement
- Dominant language
- Python
- Stars
- 3.6k
- Forks
- 487
- Avg merge
- 1d 1h
- Merged PRs (30d)
- 207
Description
https://arxiv.org/abs/2502.02538
Add reusable components and a reference implementation for offline and offline-to-online RL.
- Add a flow-matching policy module with configurable networks and a distilled one-step actor.
- Add FQLLoss covering flow-matching behavior cloning, policy distillation, Q-maximization, and critic learning.
- Reuse existing replay buffers, collectors, target updates, and evaluation utilities.
- Add a state-based SOTA recipe with Hydra configuration, documentation, tests, CI coverage, and benchmark comparisons against the reference implementation.
i'm interested in seeing this in TRL & can make a draft pr for it.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.