Multithreaded hostcall support
Nobody has claimed this yet.
- Dominant language
- Julia
- Stars
- 344
- Forks
- 79
- Avg merge
- 2d 23h
- Merged PRs (30d)
- 27
Description
Currently, a single thread serves hostcalls, but it should be possible to spawn multiple threads to service the same hostcall (especially once #50 is merged) concurrently. This would be useful for processing pipelines running on the GPU, where we want to minimize the amount of time spent waiting on the CPU to service the request. We would need to add parallel signals and buffers, and then have some scheme by which the GPU chooses which CPU thread to communicate with.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by locating the existing single-threaded hostcall implementation and review issue #50 for related changes. Define how parallel signals and buffers should support multiple CPU service threads and how the GPU selects among them. Done means the same hostcall can be serviced concurrently by multiple threads, with tests or benchmarks demonstrating concurrent processing.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- julia
- Domain
- hpc
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100