pytask-dev / pytask-dev/pytask-stata
ENH: Fix issue with parallel execution of the same do-file on Unix systems.
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 4
- Forks
- 1
- Avg merge
- 7d 8h
- Merged PRs (30d)
- 10
Description
Is your feature request related to a problem?
Stata produces log files which have the same name as the executed do-file when used in batch mode.
Parallelizing over the same do-file ...
- may create multiple workers which want to create the same log file at the same time.
- may overwrite the log produced by one task with the information from another task. Whether a task fails is partly inferred from the log file,
On Windows, there is a hacky and maybe not even intended work-around to rename the log file for every task which does not work on Unix.
Describe the solution you'd like
Nothing discussed so far.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
No file, test, or entry point is named, so first locate the pytask-stata code that launches Stata do-files and handles their logs, then inspect the Unix and Windows execution paths. Done means parallel runs of the same do-file keep separate logs on Unix, avoid overwriting one another, and still support task-failure detection.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- tooling
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100