apache / apache/pinot

Add a partialResults flag in Response metadata

Open
#7,130 4 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
6.1k
Forks
1.5k
Avg merge
1d 21h
Merged PRs (30d)
189

Description

It would be good to let the broker add a partial result flag, case I can think when this flag is set to true:
1. Any exceptions during segment processing or timeout
2. Routing table doesn't contain full segments, e.g. all replicas are down for a segment in idealStates.

Then client-side can leverage this flag to decide the behavior like retry or just surface partial results.

Contributor guide

Open the contributing guide

Research direction

Start by tracing the broker's Response metadata and the segment-processing timeout and exception paths, then inspect routing-table and idealStates handling for incomplete segments. Define how partialResults is set and exposed to clients, and add coverage for processing failures, timeouts, and unavailable replicas once the response contract is settled.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
backend-api-design, distributed-systems
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.