huggingface / huggingface/swift-chat
a bit slow on my mbp 16 m1
Open
- Dominant language
- Swift
- Stars
- 597
- Forks
- 49
- PR merge metrics
- No merged PRs in 30d
Description
I downloaded the https://huggingface.co/coreml-projects/Llama-2-7b-chat-coreml model and compiled the chat with xcode. When running the example prompt it takes around 15 minutes to complete. I am not sure what I did wrong, but the performance should be better right ?
`2023-08-09 12:01:55.346753+0200 SwiftChat[27414:583595] Metal API Validation Enabled`
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.