rl-institut / rl-institut/simbev
Results are not reproducible with multiprocessing
Open
Nobody has claimed this yet.
bug
question
- Dominant language
- Python
- Stars
- 13
- Forks
- 9
- PR merge metrics
- No merged PRs in 30d
Description
With the multiprocessing #20 introduced in #22 results are not reproducible/deterministic due to asynchronous tasks when using more than 1 thread (since the order of random drawings by jobs may differ). This could be solved by drawing all required random numbers in advance.
Can you live with this behaviour for now, @timroepcke ?
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Review the multiprocessing changes introduced in issues #20 and #22, then trace where random drawings are made for jobs. Compare results with one and multiple threads; done means repeated runs produce the same results regardless of the thread count.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- backend
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100