SciSharp / SciSharp/LLamaSharp
Thread Safety in llama.cpp
Open
Nobody has claimed this yet.
do not close
Upstream
- Dominant language
- C#
- Stars
- 3.8k
- Forks
- 508
- Avg merge
- 1d 5h
- Merged PRs (30d)
- 12
Description
Tracking issue for thread safety in llama.cpp. The global inference lock can be removed once this is resolved.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reading the linked llama.cpp issue 3960 and this tracking issue to determine what thread-safety work remains. The stated goal is to remove the global inference lock, but no files, tests, or validation steps are named, so project guidance is needed before work can begin.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- csharp
- Domain
- ai
- Issue type
- Bug
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100