huggingface / huggingface/optimum-nvidia
Avoid writting engines in `.cache/huggingface/hub`
Open
- Dominant language
- Python
- Stars
- 1k
- Forks
- 103
- Avg merge
- 2m
- Merged PRs (30d)
- 1
Description
It should either be done in `tmp` or in `.cache/huggingface/assets/` like https://github.com/AutoGPTQ/AutoGPTQ/blob/ea4a99778f90b60c9b5177d7487af1b4ca87744f/auto_gptq/utils/marlin_utils.py#L98-L101
Contributor guide
Assessment
This issue has not been assessed yet.