chaoss / chaoss/grimoirelab

parallel fetching and enriching

Open
#325 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Shell
Stars
625
Forks
231
PR merge metrics
No merged PRs in 30d

Description

I'm dealing with a large amount of github repositories. I know that Arthur can fetch data in parallel. But what about enrich process? It would be great if I can enrich data in parallel too in an effort to save time.

I tried to make the enrich processes in parallel myself, but it is hard to set locks for saving files to elasticsearch.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.