Passing an array of nulls results in incorrect StdData object in Hive
- Dominant language
- Java
- Stars
- 306
- Forks
- 75
- PR merge metrics
- No merged PRs in 30d
Description
When dealing with StdData objects, we expect that StdData.get() will never be null, instead the StdData objects itself are null. But in case of arrays of strings in Hive, we do get StdString with a null value underneath.
I think a change needs to go in https://github.com/linkedin/transport/blob/3be8352b245be25a4d0a1bc39bc166ce1c4106ec/transportable-udfs-hive/src/main/java/com/linkedin/transport/hive/HiveWrapper.java#L43 where if hiveData is null then StdData should also be returned a null.
Contributor guide
Research direction
Start in transportable-udfs-hive/src/main/java/com/linkedin/transport/hive/HiveWrapper.java around line 43 and read how hiveData is converted to StdData. Confirm the behavior for arrays of null strings, then ensure null hiveData produces a null StdData reference rather than a StdString containing null. Done means the resulting Hive data matches the expected null representation.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- backend
- Issue type
- Bug
- Difficulty
- 2/5
- Estimated time
- 1-3 hours
- Activity status
- Stale
- Clarity
- Clearly specified
- Newbie friendliness
- 50/100