huggingface / huggingface/optimum-intel
Enable Llama 3.2 11B Vision Instruct in OpenVINO
- Dominant language
- Jupyter Notebook
- Stars
- 620
- Forks
- 270
- Avg merge
- 3d 10h
- Merged PRs (30d)
- 22
Description
I request to add support for the "Llama 3.2 11B Vision Instruct" model so that we can quantize the model using optimum-cli. Currently, I get an error while trying to quantize and download the Llama 3.2 11B Vision Instruct model.
_"ValueError: Trying to export a mllama model, that is a custom or unsupported architecture, but no custom export configuration was passed as `custom_export_configs`"_
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by reproducing the Llama 3.2 11B Vision Instruct quantization failure with optimum-cli and trace the mllama export error. The work is done when the model can be downloaded and quantized without requiring an unsupported-architecture error.
Written by the indexing model from the issue text.
Assessment
- Domain
- machine-learning
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100