apache / apache/auron

string cast array missing null value

Open
#1,716 1 comment 0 reactions 0 assignees View on GitHub
stale
Dominant language
Rust
Stars
1.8k
Forks
241
Avg merge
2d 14h
Merged PRs (30d)
22

Description

**Describe the bug**

**To Reproduce**

```sql
spark-sql (default)> select * from test_t1 ;
NULL
```

```sql
set spark.auron.enable=true;
select cast(array(c1) as string ) from test_t1 ;
```
```
[]
```

---

```sql
set spark.auron.enable=false;
set spark.sql.legacy.castComplexTypesToString.enabled=false;
select cast(array(c1) as string ) from test_t1 ;
```

```
[null]
```

**Expected behavior**

**Screenshots**

**Additional context**

Contributor guide

Open the contributing guide

Research direction

Start by running the provided Spark SQL reproductions with spark.auron.enable set to true and false, then compare the cast(array(c1) as string) results when c1 is NULL. Trace the Auron path responsible for complex-type string casting; done means the enabled path preserves the null value as [null], matching the non-Auron result.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust, spark, sql
Domain
data-engineering, databases
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
38/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.