huggingface / huggingface/transformers.js

Converting a model to onnx using given script is hard(fails most of the time)

Open
#543 1 comment 0 reactions 0 assignees View on GitHub
question
Dominant language
JavaScript
Stars
16.3k
Forks
1.2k
Avg merge
6d 2h
Merged PRs (30d)
6

Description

### Question

I have tried to use starcoder model by bundling it using your ONNX script but it failed with some exception.

Model: https://huggingface.co/HuggingFaceH4/starchat-beta
or
https://huggingface.co/bigcode/starcoderbase

logs:
```bash
$ python -m scripts.convert --quantize --model_id HuggingFaceH4/starchat-beta
Framework not specified. Using pt to export to ONNX.
model-00001-of-00004.safetensors: 3%|█▏ | 346M/9.96G [03:20<1:33:01, 1.72MB/s]
Downloading shards: 0%| | 0/4 [03:23", line 198, in _run_module_as_main
File "", line 88, in _run_code
File "/home/username/Desktop/transformers.js/scripts/convert.py", line 465, in
main()
File "/home/username/Desktop/transformers.js/scripts/convert.py", line 426, in main
main_export(**export_kwargs)
File "/home/username/Desktop/transformers.js/scripts/venv/lib/python3.11/site-packages/optimum/exporters/onnx/__main__.py", line 323, in main_export
model = TasksManager.get_model_from_task(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/username/Desktop/transformers.js/scripts/venv/lib/python3.11/site-packages/optimum/exporters/tasks.py", line 1717, in get_model_from_task
model = model_class.from_pretrained(model_name_or_path, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/username/Desktop/transformers.js/scripts/venv/lib/python3.11/site-packages/transformers/models/auto/auto_factory.py", line 563, in from_pretrained
return model_class.from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/username/Desktop/transformers.js/scripts/venv/lib/python3.11/site-packages/transformers/modeling_utils.py", line 2846, in from_pretrained
raise EnvironmentError(
OSError: HuggingFaceH4/starchat-beta does not appear to have a file named pytorch_model.bin, tf_model.h5, model.ckpt or flax_model.msgpack.

```

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.