aboutcode-org / aboutcode-org/vulnerablecode
Run importers in Parallel
Aperta
- Lingua principale
- Python
- Stelle
- 702
- Fork
- 328
- Merge medio
- 3g 8h
- PR unite (30g)
- 3
Descrizione
Instead of running `./manage.py import --all` in sequence
We can use multiprocessing and try to use all CPU power.
suggestions:
- we can use Celery and schedule tasks and run easily importers in parallel
(another benefit: we can run periodic Tasks and make importers synchronize )
- we can make it simple and use some code from scancode.
this could be a solution for #833
Guida per i contributori
Nessuna guida per i contributori indicizzata per questo repository
Valutazione
Questa issue non è ancora stata valutata.