huggingface / huggingface/swift-chat
Has anyone gotten Mistral 7B Int4 working on iOS 18?
Open
- Dominant language
- Swift
- Stars
- 597
- Forks
- 49
- PR merge metrics
- No merged PRs in 30d
Description
I am trying to run Mistral 7B int4 on iPhone 15 Pro but getting this error
Running with preview version. On mac works fine.
Contributor guide
No contributing guide indexed for this repository
Research direction
Begin with the attached error screenshot and the Mistral 7B int4 run on an iPhone 15 Pro using the preview version; compare it with the working Mac run. Reproduce the behavior on iOS 18 and determine whether the model runs successfully on the phone, recording the cause or compatibility limitation.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- ios, swift
- Domain
- machine-learning, mobile-dev
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100