cockroachdb / cockroachdb/cockroach
ui: db console should omit dead nodes in queries to tsdb
Open
branch-release-23.1
branch-release-23.2
branch-release-24.1
branch-release-24.2
C-bug
O-testcluster
P-2
T-observability
- Dominant language
- Go
- Stars
- 32.5k
- Forks
- 4.1k
- PR merge metrics
- PR metrics pending
Description
When a cluster has many dead nodes, they are included in queries to tsdb and can slow down retrieval of metric dashboards significantly. We should filter these out like we do with decommissioned nodes today.
Additionally, this raises the issue of how db console should be have on a cluster with 100s of nodes when the metric queries can become quite large when we display a series per node. We should look into tsdb execution to see if there's improvements that can be made there when the number of series requested is in the hundreds.
Jira issue: CRDB-41528
Epic CRDB-42448
Contributor guide
Assessment
This issue has not been assessed yet.