huggingface/optimum-intel

View on GitHub

🤗 Optimum Intel: Accelerate inference with Intel optimization tools

Stars: 620
Forks: 270
Open beginner issues: 0
Indexed issues: 69
Avg merge: 3d 10h
Merged PRs (30d): 22

Dominant language: Jupyter Notebook
License: Apache-2.0
Last GitHub push: Sep 16, 2026
Latest indexed: Sep 17, 2026
Contributing guide: No contributing guide
Code of conduct: No code of conduct
Beginner labels: good first issue

Open All

69 open issues indexed

Quantized `flan-t5-large` RuntimeError - empty_strided not supported on quantized tensors yet Open

huggingface/optimum-intel#275 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
Running run_clm.py results GPU OOM. Open

huggingface/optimum-intel#276 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
OVModelForSeq2SeqLM with Helsinki-NLP/opus-mt-es-en has slow inference times when exported to OpenVino Open

huggingface/optimum-intel#339 · 2 comments · 0 reactions · 1 assignee · Indexed Sep 17, 2026
OVModelForSpeechSeq2Seq fails with return_timestamps="word". Open

huggingface/optimum-intel#561 · 2 comments · 0 reactions · 1 assignee · Indexed Sep 17, 2026
Not able to load Intel/bge-base-en-v1.5-rag-int8-static model Open

huggingface/optimum-intel#731 · 4 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
web documentation missing for ipex backend Open

huggingface/optimum-intel#816 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
Failed to remove Tmp directory on Windows after export openvino model Open

huggingface/optimum-intel#826 · 2 comments · 1 reaction · 0 assignees · Indexed Sep 17, 2026
Fail to execute quantized model on Ray Open

huggingface/optimum-intel#834 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
Support for Text-to-Speech models Open

enhancement

huggingface/optimum-intel#840 · 0 comments · 1 reaction · 0 assignees · Indexed Sep 17, 2026
Trying to export a bark model, that is a custom or unsupported architecture, but no custom export configuration was passed as `custom_export_configs`. Open

huggingface/optimum-intel#846 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
Performance and AMX utilization questions with optimum-intel 1.17 and 1.20 for LLM Inference on SPR CPU Open

huggingface/optimum-intel#946 · 1 comment · 0 reactions · 1 assignee · Indexed Sep 17, 2026
Not able to find `GLIBCXX_3.4.32' Open

huggingface/optimum-intel#980 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 17, 2026
INC/IPEX support with torch 2.2/2.4 Open

huggingface/optimum-intel#987 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
List available backend providers (ipex, openvino) Open

huggingface/optimum-intel#995 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
ValueError: Trying to export a SegformerForSemanticSegmentation model, that is a custom or unsupported architecture, but no custom export configuration was passed as `custom_export_configs` Open

huggingface/optimum-intel#1076 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
Intel NPU operation related Open

huggingface/optimum-intel#1081 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
Please add support for Molmo models for openvino export Open

huggingface/optimum-intel#1125 · 0 comments · 1 reaction · 0 assignees · Indexed Sep 17, 2026
我买的intel ultra 9 + cpu 32G内存 + npu 18G内存+GPU 18G内存，如何使用npu和GPU跑deepseek -R1 Open

huggingface/optimum-intel#1157 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
please support seamless-m4t model in openvino,!!!!!!!!!!!!!!!!!!! Open

huggingface/optimum-intel#1178 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
please add qwen2-5-omni support in OpenVINO Open

huggingface/optimum-intel#1227 · 0 comments · 0 reactions · 1 assignee · Indexed Sep 17, 2026
Please support stella_en_400M_v5 and stella_en_1.5B_v5 models in openvino! Open

huggingface/optimum-intel#1234 · 1 comment · 1 reaction · 0 assignees · Indexed Sep 17, 2026
Gemma3 Bidirectional Attention Mask Bug Open

huggingface/optimum-intel#1304 · 1 comment · 1 reaction · 0 assignees · Indexed Sep 17, 2026
Qwen 2.5 VL inference on NPU is not producing any output. Open

huggingface/optimum-intel#1305 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
Sana-Sprint works blank image(gray) with GPU (CPU is fine) Open

huggingface/optimum-intel#1315 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
Please add jina-reranker-v2-base-multilingual support in OpenVINO Open

huggingface/optimum-intel#1330 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
Convert bridgetower model to openvino Open

enhancement

huggingface/optimum-intel#1380 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 17, 2026
Gemma 3n support Open

huggingface/optimum-intel#1419 · 0 comments · 2 reactions · 0 assignees · Indexed Sep 17, 2026
ipex CI failing due to missing/deleted models on the intel hf hub orgs Open

huggingface/optimum-intel#1444 · 4 comments · 0 reactions · 1 assignee · Indexed Sep 17, 2026
Qwen3 OpenVINO support failing Open

huggingface/optimum-intel#1446 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 17, 2026
Add version CLI option to optimum-cli Open

huggingface/optimum-intel#1447 · 1 comment · 1 reaction · 0 assignees · Indexed Sep 17, 2026
not support qwen2.5-omni Open

huggingface/optimum-intel#1448 · 0 comments · 0 reactions · 1 assignee · Indexed Sep 17, 2026
notebooks/openvino/vision_language_quantization.ipynb failed in Step 5c Open

huggingface/optimum-intel#1488 · 4 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
Optimum-CLI: Select and convert a specific LTX-Video model version Open

huggingface/optimum-intel#1496 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
DeepSeek OCR support Open

huggingface/optimum-intel#1500 · 0 comments · 0 reactions · 1 assignee · Indexed Sep 17, 2026
Got Caught exception: bad_function_call during inference on GPU Open

huggingface/optimum-intel#1516 · 4 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
Tongyi-MAI/Z-Image-Turbo with optimum-cli but it gives me ZImagePipeline error for diffuser Open

huggingface/optimum-intel#1543 · 0 comments · 1 reaction · 0 assignees · Indexed Sep 17, 2026
MiniCPMO MAX_TRANSFORMERS_VERSION Open

huggingface/optimum-intel#1562 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
Support funasr/paraformer-zh to export OpenVINO IR model Open

huggingface/optimum-intel#1567 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
Enable Llama 3.2 11B Vision Instruct in OpenVINO Open

huggingface/optimum-intel#1571 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
Request for input shapes to be specified Open

enhancement

huggingface/optimum-intel#1581 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 17, 2026
GLM4.7 Flash Support Open

huggingface/optimum-intel#1594 · 1 comment · 6 reactions · 0 assignees · Indexed Sep 17, 2026
GigaChat3-10B-A1.8B Support ❤️ Open

huggingface/optimum-intel#1608 · 2 comments · 1 reaction · 1 assignee · Indexed Sep 17, 2026
Fix conversion of ltx_video models in bf16 format Open

good first issue

huggingface/optimum-intel#1614 · 2 comments · 0 reactions · 1 assignee · Indexed Sep 17, 2026
Phi-3.5-vision-instruct invalid EOS token Open

huggingface/optimum-intel#1630 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 17, 2026
Add support for Python 3.12 and newer Open

huggingface/optimum-intel#1639 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 17, 2026
Add tests which check, that required transformations are applied Open

good first issue

huggingface/optimum-intel#1645 · 4 comments · 0 reactions · 1 assignee · Indexed Sep 17, 2026
Add support for moonshotai/Kimi-K2.5 Open

huggingface/optimum-intel#1647 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 17, 2026
Add support for PaddleOCR-VL-1.5 Open

huggingface/optimum-intel#1654 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
Feature Request: Native OpenVINO export and NNCF quantization support for SeamlessM4T-v2 (seamless_m4t_v2) Open

huggingface/optimum-intel#1667 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
Remote Code Execution via LlavaQwen2OpenVINOConfig and Phi3VisionOpenVINOConfig Open

huggingface/optimum-intel#1668 · 4 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026

huggingface/optimum-intel

Get new issues in your inbox