IngestionSpec is not backward compatible (0.11.0 -> 0.12.1)
- Dominant language
- Java
- Stars
- 6.1k
- Forks
- 1.5k
- Avg merge
- 2d 3h
- Merged PRs (30d)
- 195
Description
https://github.com/apache/pinot/pull/9295 added the BaseSegmentPushJobRunner class and make the behavior consistent across all PushJobRunner (metadata push, uri push, tar push etc) for init() function.
URI/Metadata push used to have the validation for `pushJobSpec` while TarPush didn’t have the validation. This will make the TarPushJob fail in some cases when they are missing `pushJobSpec`.
We need to keep the backward compatibility.
Contributor guide
Research direction
Start by reviewing PR 9295 and the BaseSegmentPushJobRunner changes, then compare init() behavior across metadata, URI, and tar PushJobRunner implementations. Reproduce a TarPushJob with a missing pushJobSpec and verify that the 0.11.0 behavior remains compatible in 0.12.1.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering, databases
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100