apache / apache/druid

Add `taskType`/`category` to task related metrics

Open
#17,798 2 comments 1 reaction 0 assignees View on GitHub
Feature/Change Description
Dominant language
Java
Stars
14.1k
Forks
3.8k
Avg merge
2d 58m
Merged PRs (30d)
233

Description

### Description

I would like to see the `taskType` label/dimension on the task related metrics e.g. `task/pending/count`.
To have the `category` label/dimension on the task related metrics would also help, to know on which middlemanager category a task is being placed.

### Motivation

I would like to be able to scale my middlemanagers via an HPA.
My compaction middlemanagers are separated and thus I'd need to exclude pending task count from my scaling query when the taskType is `compact`/`partial_dimension_distribution`/`partial_index_generic_merge`/`partial_range_index_generate`.

Contributor guide

Open the contributing guide

Research direction

Start by locating the task-related metrics, including task/pending/count, and trace how their labels or dimensions are defined. Done means the requested taskType and category dimensions are available on task-related metrics, including the values needed to distinguish compaction tasks.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
observability
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
42/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.