huggingface/huggingface-inference-toolkit
View on GitHubHugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.
- Stars
- 97
- Forks
- 28
- Open beginner issues
- 0
- Indexed issues
- 9
- Avg merge
- 6d 23m
- Merged PRs (30d)
- 4
- Dominant language
- Python
- License
- Apache-2.0
- Last GitHub push
- Sep 7, 2026
- Latest indexed
- Sep 17, 2026
- Contributing guide
- No contributing guide
- Code of conduct
- No code of conduct
- Beginner labels
- No beginner labels indexed
-
Add Azure Frontend Openonhold
huggingface/huggingface-inference-toolkit#1 · 0 comments · 0 reactions · 0 assignees ·
-
Add Optimum Support Open
huggingface/huggingface-inference-toolkit#3 · 0 comments · 0 reactions · 0 assignees ·
-
huggingface/huggingface-inference-toolkit#44 · 0 comments · 0 reactions · 0 assignees ·
-
huggingface/huggingface-inference-toolkit#65 · 0 comments · 0 reactions · 0 assignees ·
-
Add Support for TPUs Opengoogle
huggingface/huggingface-inference-toolkit#67 · 0 comments · 0 reactions · 0 assignees ·
-
google
huggingface/huggingface-inference-toolkit#75 · 1 comment · 2 reactions · 1 assignee ·
-
OOM error Open
huggingface/huggingface-inference-toolkit#111 · 0 comments · 0 reactions · 0 assignees ·
-
huggingface/huggingface-inference-toolkit#121 · 0 comments · 0 reactions · 0 assignees ·
-
huggingface/huggingface-inference-toolkit#122 · 0 comments · 2 reactions · 0 assignees ·