llm.c for inference
Open
- Dominant language
- Cuda
- Stars
- 31k
- Forks
- 3.8k
- PR merge metrics
- No merged PRs in 30d
Description
Do you have the equivalent simple C implementation of LLM but for inference of LLAMA models.
I am trying to build a FPGA accelerator for LLM and a simple reference C code would be very helpful
Thanks
Contributor guide
No contributing guide indexed for this repository
Research direction
The issue names no files, tests, or entry points; start by reviewing the repository's existing raw C/CUDA training implementation and any inference-related entry points. Establish the scope needed for a simple C reference implementation for LLaMA inference, with completion defined by a working implementation and validation criteria agreed with maintainers.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- c
- Domain
- machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100