apache / apache/uniffle

[Feature] Introduce the taskId in the spark client side log

Open
#209 8 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
454
Forks
172
Avg merge
5d 17h
Merged PRs (30d)
5

Description

### Motivation
When multiple tasks are running in the same executor at the same time, it will be hard to analysis the rss log belonging to the specified task. To solve this, it's better to make log show task id in the rss client codebase.

### How to do
I think we should directly use the [MDC](https://www.baeldung.com/mdc-in-log4j-2-logback) to put the context info.

### POC screenshot
![image](https://user-images.githubusercontent.com/8609142/189322463-94bfc55b-0082-40aa-828b-88617f43cb28.png)

Contributor guide

Open the contributing guide

Research direction

Start by locating the Spark client-side RSS logging code and checking how logging context is currently handled. Review the linked MDC reference and verify that concurrent executor logs identify the task ID, using the screenshot as the expected direction.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, spark
Domain
observability
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.