karpathy / karpathy/llm.c

llm.c for inference

Open
#752 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Cuda
Stars
31k
Forks
3.8k
PR merge metrics
No merged PRs in 30d

Description

Do you have the equivalent simple C implementation of LLM but for inference of LLAMA models.
I am trying to build a FPGA accelerator for LLM and a simple reference C code would be very helpful
Thanks

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue names no files, tests, or entry points; start by reviewing the repository's existing raw C/CUDA training implementation and any inference-related entry points. Establish the scope needed for a simple C reference implementation for LLaMA inference, with completion defined by a working implementation and validation criteria agreed with maintainers.

Written by the indexing model from the issue text.

Assessment

Tech stack
c
Domain
machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.