Tests spend > 50% of time serializing Hadoop's Configuration
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
This is something we should analyze and investigate how we can bring this number down, where currently some of our tests spend > 50% of time serializing Configuration.
!Screenshot 2023-01-23 at 8.46.52 PM.png!
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-5605
- Type: Bug
- Epic: https://issues.apache.org/jira/browse/HUDI-3249
- Attachment(s):
- 24/Jan/23 04:46;alexey.kudinkin;Screenshot 2023-01-23 at 8.46.52 PM.png;https://issues.apache.org/jira/secure/attachment/13054781/Screenshot+2023-01-23+at+8.46.52+PM.png
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by reviewing the Hudi-5605 JIRA issue and its attached serialization-time screenshot, then profile the tests that serialize Hadoop's Configuration. Done means identifying the main serialization hotspots and establishing a concrete way to reduce the time spent there.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- hadoop, java
- Domain
- data-engineering, performance, testing-qa
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100