conductor-oss / conductor-oss/python-sdk

Support for asyncio based workers

未關閉
#167 1 則留言 3 個 reaction 已指派 0 人 在 GitHub 檢視
enhancement
主要語言
Python
星號
104
分支
42
平均合併
2 天 1 小時
30 天內合併 PR
3

描述

The current worker implementation model uses multiprocessing for parallel execution but each process blocks on task execution (though it might be waiting on I/O). Is there a possibility to use asyncio/threaded approach to alleviate this problem and think of a model where processes could be used for parallelization (using multiple cores) and each process has an event loop/ThreadPool to poll and execute tasks to maximize performance on each core ?

I'd be happy to discuss more on this and submit a PR if required as well. Thanks for all the awesome work so far 👍

貢獻指南

這個儲存庫沒有索引到貢獻指南

評估

這個 Issue 還沒有評估資料。

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。