huggingface / huggingface/optimum-intel

Trying to export a bark model, that is a custom or unsupported architecture, but no custom export configuration was passed as `custom_export_configs`.

Open
#846 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
620
Forks
270
Avg merge
3d 10h
Merged PRs (30d)
22

Description

from transformers import AutoProcessor, AutoModel
from optimum.intel import OVModelForCausalLM

model_id = "suno/bark-small"
processor = AutoProcessor.from_pretrained("suno/bark-small")
model = OVModelForCausalLM.from_pretrained(model_id, export=True)

Framework not specified. Using pt to export the model.
---------------------------------------------------------------------------
ValueError Traceback (most recent call last)
[](https://localhost:8080/#) in ()
----> 1 model = OVModelForCausalLM.from_pretrained(model_id, export=True)

2 frames
[/usr/local/lib/python3.10/dist-packages/optimum/exporters/openvino/__main__.py](https://localhost:8080/#) in main_export(model_name_or_path, output, task, device, framework, cache_dir, trust_remote_code, pad_token_id, subfolder, revision, force_download, local_files_only, use_auth_token, token, model_kwargs, custom_export_configs, fn_get_submodels, compression_option, compression_ratio, ov_config, stateful, convert_tokenizer, library_name, **kwargs_shapes)
228 custom_architecture = True
229 if custom_export_configs is None:
--> 230 raise ValueError(
231 f"Trying to export a {model_type} model, that is a custom or unsupported architecture, but no custom export configuration was passed as `custom_export_configs`. Please refer to https://huggingface.co/docs/optimum/main/en/exporters/onnx/usage_guides/export_a_model#custom-export-of-transformers-models for an example on how to export custom models. Please open an issue at https://github.com/huggingface/optimum-intel/issues if you would like the model type {model_type} to be supported natively in the OpenVINO export."
232 )

ValueError: Trying to export a bark model, that is a custom or unsupported architecture, but no custom export configuration was passed as `custom_export_configs`. Please refer to https://huggingface.co/docs/optimum/main/en/exporters/onnx/usage_guides/export_a_model#custom-export-of-transformers-models for an example on how to export custom models. Please open an issue at https://github.com/huggingface/optimum-intel/issues if you would like the model type bark to be supported natively in the OpenVINO export.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.