conductor-oss / conductor-oss/python-sdk

Support for asyncio based workers

Ouverte
#167 1 commentaire 3 réactions 0 personnes assignées Voir sur GitHub
enhancement
Langage dominant
Python
Étoiles
104
Forks
42
Merge moyen
2 j 1 h
PR mergées (30 j)
3

Description

The current worker implementation model uses multiprocessing for parallel execution but each process blocks on task execution (though it might be waiting on I/O). Is there a possibility to use asyncio/threaded approach to alleviate this problem and think of a model where processes could be used for parallelization (using multiple cores) and each process has an event loop/ThreadPool to poll and execute tasks to maximize performance on each core ?

I'd be happy to discuss more on this and submit a PR if required as well. Thanks for all the awesome work so far 👍

Guide de contribution

Aucun guide de contribution indexé pour ce dépôt

Évaluation

Cette issue n'a pas encore été évaluée.

Recevez les nouvelles issues par e-mail

Un résumé court des issues GitHub adaptées aux débutants.