parallel fetching and enriching
Open
enhancement
- Dominant language
- Shell
- Stars
- 625
- Forks
- 231
- PR merge metrics
- No merged PRs in 30d
Description
I'm dealing with a large amount of github repositories. I know that Arthur can fetch data in parallel. But what about enrich process? It would be great if I can enrich data in parallel too in an effort to save time.
I tried to make the enrich processes in parallel myself, but it is hard to set locks for saving files to elasticsearch.
Contributor guide
Assessment
This issue has not been assessed yet.