[Feature] Allow users to specify custom spawners
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 77
- Forks
- 7
- Avg merge
- 10h 32m
- Merged PRs (30d)
- 12
Description
At the moment the spawner module provides four different interfaces to start a new process, using a subprocess, mpiexec, srun or flux run. But different clusters might have different commands to trigger MPI parallel runs or in principle it would also be possible to add additional computing resources from a cloud provider to speed up an application running on your laptop. Either way it would be great to add the option to provide custom spawners.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reading src/executorlib/standalone/interactive/spawner.py and the existing subprocess, mpiexec, srun, and flux run interfaces. Determine how a custom spawner should be supplied and what its contract must be; done means users can provide custom process-launch commands alongside the existing interfaces.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- distributed-systems, hpc
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100