huggingface / huggingface/optimum-intel

not support qwen2.5-omni

Open
#1,448 0 comments 0 reactions 1 assignee Claimed by @rkazants View on GitHub
Dominant language
Jupyter Notebook
Stars
620
Forks
270
Avg merge
3d 10h
Merged PRs (30d)
22

Description

(.venv) PS C:\Users\aiouya\PycharmProjects\PythonProject3> optimum-cli export openvino `
>> --model "./Qwen2.5-Omni-7B" `
>> --task text-generation `
>> --weight-format int8 `
>> --trust-remote-code `
>> "./qwen2_5_text_ir"
C:\Users\aiouya\PycharmProjects\PythonProject3\.venv\Lib\site-packages\torch\onnx\_internal\registration.py:162: OnnxExporterWarning: Symbolic function 'aten::scaled_dot_product_attention' already registered for opset 14. Replacing the existing function with new function. This is unexpected. Please report it on https://github.com/pytorch/pytorch/issues.
warnings.warn(
Unrecognized keys in `rope_scaling` for 'rope_type'='default': {'mrope_section'}
Traceback (most recent call last):
File "", line 198, in _run_module_as_main
File "", line 88, in _run_code
File "C:\Users\aiouya\PycharmProjects\PythonProject3\.venv\Scripts\optimum-cli.exe\__main__.py", line 6, in
File "C:\Users\aiouya\PycharmProjects\PythonProject3\.venv\Lib\site-packages\optimum\commands\optimum_cli.py", line 208, in main
service.run()
File "C:\Users\aiouya\PycharmProjects\PythonProject3\.venv\Lib\site-packages\optimum\commands\export\openvino.py", line 577, in run
main_export(
File "C:\Users\aiouya\PycharmProjects\PythonProject3\.venv\Lib\site-packages\optimum\exporters\openvino\__main__.py", line 267, in main_export
raise ValueError(
ValueError: Trying to export a qwen2_5_omni model, that is a custom or unsupported architecture, but no
custom export configuration was passed as `custom_export_configs`. Please refer to https://huggingface
.co/docs/optimum/main/en/exporters/onnx/usage_guides/export_a_model#custom-export-of-transformers-model
s for an example on how to export custom models. Please open an issue at https://github.com/huggingface
/optimum-intel/issues if you would like the model type qwen2_5_omni to be supported natively in the OpenVINO export.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.