linkedin / linkedin/transport

Passing an array of nulls results in incorrect StdData object in Hive

Open
#35 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
306
Forks
75
PR merge metrics
No merged PRs in 30d

Description

When dealing with StdData objects, we expect that StdData.get() will never be null, instead the StdData objects itself are null. But in case of arrays of strings in Hive, we do get StdString with a null value underneath.

I think a change needs to go in https://github.com/linkedin/transport/blob/3be8352b245be25a4d0a1bc39bc166ce1c4106ec/transportable-udfs-hive/src/main/java/com/linkedin/transport/hive/HiveWrapper.java#L43 where if hiveData is null then StdData should also be returned a null.

Contributor guide

Open the contributing guide

Research direction

Start in transportable-udfs-hive/src/main/java/com/linkedin/transport/hive/HiveWrapper.java around line 43 and read how hiveData is converted to StdData. Confirm the behavior for arrays of null strings, then ensure null hiveData produces a null StdData reference rather than a StdString containing null. Done means the resulting Hive data matches the expected null representation.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
backend
Issue type
Bug
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Stale
Clarity
Clearly specified
Newbie friendliness
50/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.