apache / apache/pinot

[multistage][feature] allow broker to also run WorkerQuery engine

Open
#9,368 0 comments 0 reactions 0 assignees View on GitHub
multi-stage
Dominant language
Java
Stars
6.1k
Forks
1.5k
Avg merge
1d 21h
Merged PRs (30d)
189

Description

intermediate stage of the multi-stage engine is data locale unaware. so technically we can also register broker nodes as workers on intermediate stage engine.

Contributor guide

Open the contributing guide

Research direction

Start by tracing the multi-stage engine's intermediate stage and how broker nodes and the WorkerQuery engine are registered. Confirm whether the intermediate stage is data-locale unaware as described, then determine the design and tests needed to allow broker nodes to run WorkerQuery there. Done means broker nodes can be registered and operate as workers without breaking existing multi-stage behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
distributed-systems
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.