conductor-oss / conductor-oss/python-sdk
Support for asyncio based workers
未關閉
enhancement
- 主要語言
- Python
- 星號
- 104
- 分支
- 42
- 平均合併
- 2 天 1 小時
- 30 天內合併 PR
- 3
描述
The current worker implementation model uses multiprocessing for parallel execution but each process blocks on task execution (though it might be waiting on I/O). Is there a possibility to use asyncio/threaded approach to alleviate this problem and think of a model where processes could be used for parallelization (using multiple cores) and each process has an event loop/ThreadPool to poll and execute tasks to maximize performance on each core ?
I'd be happy to discuss more on this and submit a PR if required as well. Thanks for all the awesome work so far 👍
貢獻指南
這個儲存庫沒有索引到貢獻指南
評估
這個 Issue 還沒有評估資料。