apache / apache/gluten

[VL] DBI leads to data lose

Open
#12,545 1 comment 0 reactions 0 assignees View on GitHub
bug triage
Dominant language
Scala
Stars
1.6k
Forks
657
Avg merge
3d 17h
Merged PRs (30d)
86

Description

### Backend

VL (Velox)

### Bug description

For some reason, the preload threads crashed, but the task thread doesn't catch the exception and doesn't retry. It's weird that the task succeeds without any error. Then the data is lost.

### Gluten version

_No response_

### Spark version

None

### Spark configurations

_No response_

### System information

_No response_

### Relevant logs

```bash

```

Contributor guide

Open the contributing guide

Research direction

Start with the Velox backend path that creates preload threads and follow how exceptions reach the task thread. Reproduce the crash described in the issue, then verify that the task no longer succeeds silently when preload work fails and that the relevant error or retry behavior prevents data loss.

Written by the indexing model from the issue text.

Assessment

Tech stack
scala
Domain
backend, data
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.