Parallelize generation on maps
Open
- Dominant language
- Python
- Stars
- 8
- Forks
- 16
- Avg merge
- 1d 13h
- Merged PRs (30d)
- 7
Description
On large datasets the generation of maps takes an extremely long time.
Ran generation of avg maps on the Snorre field took 8 hours to produce close to 500 maps.
Introducing async and possibly multiprocessing should cut that time significantly
Contributor guide
Research direction
The issue names no files, tests, or entry points. Start by locating the map-generation entry point and measuring the large-dataset path described for the Snorre field; determine whether async or multiprocessing fits the workload. Done means map generation is parallelized and the reported long runtime is materially reduced without changing the generated maps.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- performance
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 30/100