[DataAvailability] Implement Forest Manager
@peterargue is already working on this.
Since Jun 30, 2025.
- Dominant language
- Go
- Stars
- 575
- Forks
- 217
- Avg merge
- 4d 20h
- Merged PRs (30d)
- 9
Description
The ingestion engine will add results to the forest as soon as they are discovered. There will also be a queue of pipelines that are ready to execute and a pool of workers pulling and executing these jobs.
However, not all results will be ready to start processing immediately after being added to the tree. There may be some criteria that must be met before first. See the design doc for the specific criteria.
Create the forest manager module. The manager will receive signals from the ingestion engine when blocks are sealed/finalized and each time a new result or receipt is added to the forest. On each signal, the manager will check if any new pipelines are ready to be executed. if they are, it will add them to the queue.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.