apache / apache/druid

Pass task required properties from overlord to task pod

Open
#17,773 0 comments 0 reactions 0 assignees View on GitHub
Contributions Welcome Feature/Change Description
Dominant language
Java
Stars
14.1k
Forks
3.8k
Avg merge
2d 58m
Merged PRs (30d)
233

Description

### Description

![Image](https://github.com/user-attachments/assets/c527cb8d-a40b-4b3a-9894-eb0e0d4c6467)

As stated by the [doc](https://druid.apache.org/docs/latest/development/extensions-contrib/k8s-jobs#migrationkubernetes-and-worker-task-runner) above, these two properties should be configured to peon tasks.

However, these two properties should be only present at the overlord side to create a task POD, and if task pod really needs these two properties, overlord should pass these two to task POD in the background for users.

Managing thes properties in K8S is tedious, because we have to keep two copies of these properties, one at the overlord side, another at the peon side.

Removing these two from peon would help ease the configuration.

Contributor guide

Open the contributing guide

Research direction

Start with the linked Kubernetes and Worker Task Runner migration documentation and identify the two properties referenced there; the issue does not name their keys or implementation files. Trace how the Overlord creates the task pod, then verify that users configure the properties only on the Overlord while the pod still receives them automatically.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, kubernetes
Domain
devops, distributed-systems
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.