linkedin / linkedin/dr-elephant
Auto Tuner BaselineComputeUtil throw NPE
Open
Nobody has claimed this yet.
- Dominant language
- Java
- Stars
- 1.4k
- Forks
- 839
- PR merge metrics
- No merged PRs in 30d
Description
08-23-2018 19:14:04 INFO [dr-el-executor-thread-0] com.linkedin.drelephant.ElephantRunner : Analyzing MAPREDUCE application_1534749546006_16077
08-23-2018 19:14:04 INFO [Auto Tuner Thread] com.linkedin.drelephant.tuning.BaselineComputeUtil : Starting baseline computation
08-23-2018 19:14:04 INFO [Auto Tuner Thread] com.linkedin.drelephant.tuning.BaselineComputeUtil : Fetching jobs for which baseline metrics need to be computed
08-23-2018 19:14:04 INFO [Auto Tuner Thread] com.linkedin.drelephant.tuning.BaselineComputeUtil : Computing and updating baseline metric values for job: wordcountpig
08-23-2018 19:14:04 ERROR [Auto Tuner Thread] com.linkedin.drelephant.tuning.BaselineComputeUtil : Error in computing baseline for job: wordcountpig
java.lang.NullPointerException
at com.linkedin.drelephant.tuning.BaselineComputeUtil.getAvgInputSizeInBytes(BaselineComputeUtil.java:151)
at com.linkedin.drelephant.tuning.BaselineComputeUtil.updateBaselineForJob(BaselineComputeUtil.java:123)
at com.linkedin.drelephant.tuning.BaselineComputeUtil.computeBaseline(BaselineComputeUtil.java:58)
at com.linkedin.drelephant.AutoTuner.run(AutoTuner.java:66)
at java.lang.Thread.run(Thread.java:745)
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start in BaselineComputeUtil.java at getAvgInputSizeInBytes line 151, then trace updateBaselineForJob and computeBaseline from the stack trace. Reproduce the Auto Tuner failure for the wordcountpig job and determine what causes the NullPointerException; done means baseline computation completes without this exception.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- hadoop, java
- Domain
- backend, performance
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100