✨[Feature] Use a R/W Lock to manage building engines for MGMN setups
Open
@apbose is already working on this.
Since Dec 9, 2025.
feature request
Story: Multi-GPU & Distributed & Custom Ops
- Dominant language
- Python
- Stars
- 3k
- Forks
- 410
- Avg merge
- 3d 18h
- Merged PRs (30d)
- 78
Description
Is your feature request related to a problem? Please describe.
Describe the solution you'd like
An implementation of the engine cache that is concurrency aware. Should spin lock repeated requests until they are satisfied by one of the workers
Describe alternatives you've considered
Additional context
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.