[VL] TextReadOptions is incomplete for text file format reader
Open
bug
triage
- Dominant language
- Scala
- Stars
- 1.6k
- Forks
- 657
- Avg merge
- 2d 14h
- Merged PRs (30d)
- 80
Description
### Backend
VL (Velox)
### Bug description
TextReadOptions in algebra.proto file is incomplete for description the options for text format files:
https://github.com/apache/incubator-gluten/blob/main/gluten-core/src/main/resources/substrait/proto/substrait/algebra.proto#L138-L147
the text format file options in velox as bellow:
text format read options in velox:
https://github.com/facebookincubator/velox/blob/main/velox/dwio/common/Options.h#L72C1-L83C63
### Spark version
None
### Spark configurations
_No response_
### System information
_No response_
### Relevant logs
_No response_
Contributor guide
Assessment
This issue has not been assessed yet.