Joystream / Joystream/joystream

Improve concurrent downloads mechanism

Open
#5,052 0 comments 0 reactions 1 assignee Claimed by @zeeshanakram3 View on GitHub
colossus
Dominant language
Rust
Stars
1.4k
Forks
116
PR merge metrics
No merged PRs in 30d

Description

Colossus has an implementation for queuing and processing tasks in a work stack. There are several problems with the implementation especially the way it is used in the syncing worker. To get the best concurrency the sync worker should add all tasks to the work queue.

We should improve it to get better concurrency without the limitation mentioned above and to work better when we improve on how we fetch tasks in batches (see: https://github.com/Joystream/joystream/issues/5051)

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.