apache / apache/gluten

[VL] Velox not supports iceberg orc read timestamptz

Open
#8,935 0 comments 0 reactions 0 assignees View on GitHub
bug triage
Dominant language
Scala
Stars
1.6k
Forks
657
Avg merge
2d 14h
Merged PRs (30d)
80

Description

### Backend

VL (Velox)

### Bug description

TestFilteredScan remove the parameter for orc type, otherwise, throws exception.
Because we cannot distinguish file format but can only get the schema in BatchScanTransformer
```

Error Source: RUNTIME
Error Code: INVALID_STATE
Reason: TIMESTAMP_INSTANT not supported yet.
Retriable: False
Context: Split [Hive: /var/folders/63/845y6pk53dx_83hpw8ztdchw0000gn/T/junit10976573641877215189/TestFilteredScan/unpartitioned/data/b464438c-e706-412b-bcc9-71321ff4aead.orc 0 - 629] Task Gluten_Stage_6_TID_6_VTID_4
Additional Context: Operator: TableScan[0] 0
Function: kind
File: code/gluten/ep/build-velox/build/velox_ep/velox/dwio/dwrf/common/FileMetadata.cpp
Line: 107
Stack trace:
```

### Spark version

None

### Spark configurations

_No response_

### System information

_No response_

### Relevant logs

```bash

```

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.