apache / apache/gluten

[VL] Result mismatch when json contains newline character using get_json_object

Open
#9,688 3 comments 0 reactions 0 assignees View on GitHub
bug triage
Dominant language
Scala
Stars
1.6k
Forks
657
Avg merge
2d 21h
Merged PRs (30d)
85

Description

### Backend

VL (Velox)

### Bug description

Reproduce SQL: select get_json_object('{"a": "3803\n"}','$.a');
vanilla spark result: 3803\n
gluten result: NULL

### Gluten version

Gluten-1.3

### Spark version

Spark-3.5.x

### Spark configurations

_No response_

### System information

_No response_

### Relevant logs

```bash

```

Contributor guide

Open the contributing guide

Research direction

Start by reproducing the SQL query with Gluten 1.3 and Spark 3.5.x, then compare its result with vanilla Spark. Trace the get_json_object handling for a JSON value containing a newline; done means Gluten returns 3803 followed by the newline rather than NULL.

Written by the indexing model from the issue text.

Assessment

Tech stack
scala, spark, sql
Domain
backend, data
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.