Is the QNN backend support the model of Llama 3.2 3B instead of XNNPACK？
Open
Nobody has claimed this yet.
module: qnn
need-user-input
partner: qualcomm
- Dominant language
- Python
- Stars
- 5k
- Forks
- 1.2k
- Avg merge
- 2d 10h
- Merged PRs (30d)
- 581
Description
🐛 Describe the bug
I have run the XNNPACK tutorial and the pte file can run normally. but when I run the tutorial of Llama 3 8B and change the model to Llama 3.2 3B, the model load fail on the Android device of Qualcomm 8Gen 2， the fail code is 1.
QNN:2.26
SDK:r27b
Versions
QNN:2.26
SDK:r27b
cc @cccclai @winskuo-quic @shewu-quic @cbilgin
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by comparing the XNNPACK tutorial with the Llama 3 8B tutorial after substituting Llama 3.2 3B. Reproduce the model-load failure on Android with Qualcomm 8 Gen 2 using QNN 2.26 and SDK r27b, then verify whether QNN backend support exists for this model and document the cause of failure code 1.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- android
- Domain
- machine-learning, mobile
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 25/100