huggingface / huggingface/optimum-amd

Running the example code from Optimum documentation fails

Open
#88 4 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
101
Forks
21
Avg merge
58m
Merged PRs (30d)
1

Description

Hello,

I was just trying to get the example code from [optimum documentation](https://huggingface.co/docs/optimum/amd/ryzenai/overview) up and running before I try to get an LLM to run on the NPU, but I keep getting this error: `ImportError: cannot import name 'AutoQuantizationConfig' from 'optimum.amd.ryzenai'`.

I checked the files and I can't find AutoQuantizationConfig class anywhere. I also checked the versions, and I am on the latest one (optimum - 1.17.1, optimum-amd - 0.1.0)

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.