huggingface / huggingface/optimum-intel

Not able to find `GLIBCXX_3.4.32'

Open
#980 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
620
Forks
270
Avg merge
3d 10h
Merged PRs (30d)
22

Description

After quantizing the model i am loading model to cuda then this error has come oftenly.

```
[/home/ubuntu/miniconda3/envs/dev-2/lib/python3.12/site-packages/optimum/quanto/library/ops.py:66](http://13.48.147.30:8001/lab/workspaces/auto-H/tree/LogoMaker/App/miniconda3/envs/dev-2/lib/python3.12/site-packages/optimum/quanto/library/ops.py#line=65): UserWarning: An exception was raised while calling the optimized kernel for quanto::unpack: /home/ubuntu/miniconda3/envs/dev-2/lib/python3.12/site-packages/zmq/backend/cython/../../../../.././libstdc++.so.6: version `GLIBCXX_3.4.32' not found (required by [/home/ubuntu/miniconda3/envs/dev-2/lib/python3.12/site-packages/optimum/quanto/library/extensions/cuda/build/quanto_cuda.so](http://13.48.147.30:8001/lab/workspaces/auto-H/tree/LogoMaker/App/miniconda3/envs/dev-2/lib/python3.12/site-packages/optimum/quanto/library/extensions/cuda/build/quanto_cuda.so)) Falling back to default implementation.
warnings.warn(message + " Falling back to default implementation.")
```

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.