apache / apache/pinot

MSE Brokers Cold Start Errors

Open
#18,110 1 comment 0 reactions 0 assignees View on GitHub
multi-stage stale
Dominant language
Java
Stars
6.1k
Forks
1.5k
Avg merge
1d 21h
Merged PRs (30d)
189

Description

Long initial class loading and networking times on the query path, for example Calcite class loading during compilation, can lead to errors if the first MSE queries received on the broker have tight timeout constraints (~1-2 seconds).

We can reliably reproduce these `Timed out while planning query` errors on the first few MSE queries, all with 1s timeouts, received on broker startup:
```
ERROR [PinotClientRequest] [jersey-server-managed-async-executor-9:210] Query processing exceptions: {400=BrokerTimeoutError: Timed out while planning query}
```

Contributor guide

Open the contributing guide

Research direction

Start by reproducing the reported errors with the first few MSE queries received after broker startup, using the stated one-second timeout. Trace the query path through class loading, networking, and planning to identify the relevant entry points; done means those initial queries no longer fail with "Timed out while planning query" under the reported conditions.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
backend
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.