[multi-stage] [error-handling] No early termination for leaf stage server query request
Open
multi-stage
- Dominant language
- Java
- Stars
- 6.1k
- Forks
- 1.5k
- Avg merge
- 2d 55m
- Merged PRs (30d)
- 182
Description
Time out is not passed down to server query request. each of them is set to 15s by default.
No early termination means if they are timing out, we will spend # of requests x 15s time spinning CPU.
The worst thing is, if we are sharing the resource with v1 server, queries sent to v1 engine will be impacted.
Contributor guide
Assessment
This issue has not been assessed yet.