huggingface / huggingface/optimum-amd
Running the example code from Optimum documentation fails
Open
- Dominant language
- Jupyter Notebook
- Stars
- 101
- Forks
- 21
- Avg merge
- 58m
- Merged PRs (30d)
- 1
Description
Hello,
I was just trying to get the example code from [optimum documentation](https://huggingface.co/docs/optimum/amd/ryzenai/overview) up and running before I try to get an LLM to run on the NPU, but I keep getting this error: `ImportError: cannot import name 'AutoQuantizationConfig' from 'optimum.amd.ryzenai'`.
I checked the files and I can't find AutoQuantizationConfig class anywhere. I also checked the versions, and I am on the latest one (optimum - 1.17.1, optimum-amd - 0.1.0)
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.