bigscience-workshop / bigscience-workshop/petals
DynamicCache and Beam Search
Open
- Dominant language
- Python
- Stars
- 10.6k
- Forks
- 650
- PR merge metrics
- No merged PRs in 30d
Description
Make sure that `RemotePastKeyValues` will reorder beams when the method `reorder_cache` is called.
Related: #570
- [ ] Write down a code for reordering
- [ ] Add Beam-Search scores comparison in the test
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.