huggingface / huggingface/course
LLM Course:- Chapter 2(Infrence Deployment Not Working )
Open
- Dominant language
- MDX
- Stars
- 4.2k
- Forks
- 1.4k
- Avg merge
- 13m
- Merged PRs (30d)
- 1
Description
[Optimized Inference Deployment](https://huggingface.co/learn/llm-course/chapter2/8)
# Clone the repository
git clone https://github.com/ggerganov/llama.cpp
cd llama.cpp
# Build the project
make
# Download the SmolLM2-1.7B-Instruct-GGUF model
curl -L -O https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B-Instruct-GGUF/resolve/main/smollm2-1.7b-instruct.Q4_K_M.gguf`
I have tried the code on my mac but got error, I think the doc is not updated
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.