Lightning-AI/LitServe
View on GitHubA minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.
- Stars
- 3.9k
- Forks
- 304
- Open beginner issues
- 0
- Indexed issues
- 33
- Avg merge
- 3d 13h
- Merged PRs (30d)
- 6
- Dominant language
- Python
- License
- Apache-2.0
- Last GitHub push
- Sep 10, 2026
- Latest indexed
- Sep 19, 2026
- Contributing guide
- Contributing guide
- Code of conduct
- Code of conduct
- Beginner labels
- help wanted good first issue
3 beginner-friendly issues open
Loading issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
Lightning-AI/LitServe#747 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
Lightning-AI/LitServe#745 ·
-
bug help wanted
Difficulty 2/5 1-3 hours Newbie friendliness 70/100
Lightning-AI/LitServe#667 · 2 comments ·