huggingface / huggingface/swift-transformers
Optimization: cache past key-values
Open
enhancement
modelling
- Dominant language
- Swift
- Stars
- 1.4k
- Forks
- 209
- Avg merge
- 2d 7h
- Merged PRs (30d)
- 4
Description
This needs to go hand in hand with changes to the conversion process in [`exporters`](https://github.com/huggingface/exporters) and [`transformers-to-coreml`](https://huggingface.co/spaces/coreml-projects/transformers-to-coreml).
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.