Compute worker: changing `HOST_DIRECTORY` not working
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 176
- Forks
- 74
- Avg merge
- 5d 3h
- Merged PRs (30d)
- 21
Description
Description
A bug happen when selecting a HOST_DIRECTORY different than /codabench. Note that the problem does not occur if the directory on host and inside the container are /codabench.
Let's say we have HOST_DIRECTORY = /home/codabench/ and the desired directory is /codabench/data/temp/. Then makedirs will try to create /home/codabench/data/temp inside the container, which leads to an error.
Fix
A fix was proposed here:
- #2315
But we should do a proper fix for this bug.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reviewing the compute worker code that handles HOST_DIRECTORY and the makedirs call, then compare the proposed fix in issue #2315. Reproduce the case with a host directory other than /codabench and verify that the desired container path is created without using the host path inside the container.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- infrastructure
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Quiet
- Clarity
- Mostly clear
- Newbie friendliness
- 48/100