How are results retrieved from workers
Nobody has claimed this yet.
- Dominant language
- R
- Stars
- 184
- Forks
- 53
- Avg merge
- 7d 2h
- Merged PRs (30d)
- 1
Description
Hello, I came across this package that seems fabulous. I have a question, if this is not the right channel please let me know and I'll delete.
I use slurm and have been using rslurm. problem I found is a that results on each workers are stored as Rdata file and reloaded on master. Even by changing this to fst files this is problematic and slow. Can I ask if batchtools is using files too in the retrieving process?
Many thanks
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The issue names no files, tests, or entry points. Start by locating how batchtools retrieves worker results under Slurm, then document whether files are used and how that retrieval works; done means the question has a specific, supported answer.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- r
- Domain
- distributed-systems, hpc
- Issue type
- Documentation
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 15/100