[VL] DBI leads to data lose
- Dominant language
- Scala
- Stars
- 1.6k
- Forks
- 657
- Avg merge
- 3d 17h
- Merged PRs (30d)
- 86
Description
### Backend
VL (Velox)
### Bug description
For some reason, the preload threads crashed, but the task thread doesn't catch the exception and doesn't retry. It's weird that the task succeeds without any error. Then the data is lost.
### Gluten version
_No response_
### Spark version
None
### Spark configurations
_No response_
### System information
_No response_
### Relevant logs
```bash
```
Contributor guide
Research direction
Start with the Velox backend path that creates preload threads and follow how exceptions reach the task thread. Reproduce the crash described in the issue, then verify that the task no longer succeeds silently when preload work fails and that the relevant error or retry behavior prevents data loss.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- scala
- Domain
- backend, data
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100