huggingface / huggingface/course
TGI Installation will for ghcr.io/huggingface/text-generation-inference:latest will not work on Mac
Open
- Dominant language
- MDX
- Stars
- 4.2k
- Forks
- 1.4k
- Avg merge
- 13m
- Merged PRs (30d)
- 1
Description
In the Inference Optimisation [chapter](ghcr.io/huggingface/text-generation-inference:latest), there is no image suitable for Apple Silicon for ghcr.io/huggingface/text-generation-inference:latest and the AMD version does not work since it searches for NVIDEA GPU.
Recommendation: Maybe adding a small box that warns the users that TGI will not work locally on Apple Silicon Macs
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.