How do we create the python env on worker nodes?
Open
Nobody has claimed this yet.
DLIO or mlpstorage
- Dominant language
- Python
- Stars
- 203
- Forks
- 67
- Avg merge
- 20m
- Merged PRs (30d)
- 8
Description
How do we instantiate the python3 environment and support libraries on the worker nodes?
We need to use uv to get all the right versions there, but the mpirun commands are invoking the raw workload generators (eg: dlio, etc).
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
No files or tests are named. Start by tracing the mpirun commands that launch the raw workload generators, including dlio, and determine where uv-based Python environment setup belongs for worker nodes; done means those commands use the required Python and support-library versions on each worker.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- distributed-systems, infrastructure
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100