Dumpping jobInfo from mem into a file
Open
- Dominant language
- Scala
- Stars
- 2.4k
- Forks
- 1k
- PR merge metrics
- No merged PRs in 30d
Description
### 1. Describe the feature
Dumpping jobInfo from mem into a file.
Need to support local log file and remote file in hdfs.
### 2. Motivation
### 3. Describe the solution
### 4. Additional context
Contributor guide
Research direction
No files, tests, or entry points are named. Start by locating where jobInfo is held in memory and how local files and HDFS are currently handled; define the storage and retrieval flow for both destinations, then verify that jobInfo can be dumped successfully to each.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- hadoop, scala
- Domain
- backend, data-engineering, distributed-systems
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100