huggingface / huggingface/optimum-intel
Not able to find `GLIBCXX_3.4.32'
- Dominant language
- Jupyter Notebook
- Stars
- 620
- Forks
- 270
- Avg merge
- 3d 10h
- Merged PRs (30d)
- 22
Description
After quantizing the model i am loading model to cuda then this error has come oftenly.
```
[/home/ubuntu/miniconda3/envs/dev-2/lib/python3.12/site-packages/optimum/quanto/library/ops.py:66](http://13.48.147.30:8001/lab/workspaces/auto-H/tree/LogoMaker/App/miniconda3/envs/dev-2/lib/python3.12/site-packages/optimum/quanto/library/ops.py#line=65): UserWarning: An exception was raised while calling the optimized kernel for quanto::unpack: /home/ubuntu/miniconda3/envs/dev-2/lib/python3.12/site-packages/zmq/backend/cython/../../../../.././libstdc++.so.6: version `GLIBCXX_3.4.32' not found (required by [/home/ubuntu/miniconda3/envs/dev-2/lib/python3.12/site-packages/optimum/quanto/library/extensions/cuda/build/quanto_cuda.so](http://13.48.147.30:8001/lab/workspaces/auto-H/tree/LogoMaker/App/miniconda3/envs/dev-2/lib/python3.12/site-packages/optimum/quanto/library/extensions/cuda/build/quanto_cuda.so)) Falling back to default implementation.
warnings.warn(message + " Falling back to default implementation.")
```
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.