apache / apache/gluten

When timezone param of unix_timestamp is CST, ambiguous zone will lead different result.

Open
#12,411 1 comment 0 reactions 0 assignees View on GitHub
bug triage
Dominant language
Scala
Stars
1.6k
Forks
657
Avg merge
2d 21h
Merged PRs (30d)
85

Description

### Backend

VL (Velox)

### Bug description

example:
```
set spark.sql.optimizer.excludedRules=org.apache.spark.sql.catalyst.optimizer.ConstantFolding;
select from_unixtime(
unix_timestamp('Sun Jun 14 20:00:05 CST 2026', 'EEE MMM dd HH:mm:Ss z yyyy'),
'yyyy-MM-dd HH:mm:ss');
```

vanilla: 2026-06-14 20:00:05
gluten: 2026-06-15 09:00:05

### Gluten version

1.6.0
### Spark version

3.5.8

### Spark configurations

spark.sql.legacy.timeParserPolicy=LEGACY

### System information

_No response_

### Relevant logs

```bash

```

Contributor guide

Open the contributing guide

Research direction

Start by reproducing the unix_timestamp/from_unixtime query with spark.sql.legacy.timeParserPolicy=LEGACY on the VL backend and compare it with vanilla Spark. Trace how the CST timezone is parsed and converted, then verify that the result matches vanilla Spark for the supplied query.

Written by the indexing model from the issue text.

Assessment

Tech stack
spark
Domain
backend, data
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.