Support record delimiter ("terminator" in Arrow terms) for CSV writing
- Dominant language
- Rust
- Stars
- 9.3k
- Forks
- 2.4k
- Avg merge
- 3d 7h
- Merged PRs (30d)
- 344
Description
### Is your feature request related to a problem or challenge?
Use CRLF sequence or any other byte character from CSV option as line terminator for CSV writer.
Dual of https://github.com/apache/datafusion/issues/12215 for CSV writing/data sink.
### Describe the solution you'd like
`CsvWriterOptions` built from `CsvOptions` should carry over line terminator setting, just like other CSV options, [here](https://github.com/apache/datafusion/blob/main/datafusion/common/src/file_options/csv_writer.rs#L64-L103).
Dependant on https://github.com/apache/arrow-rs/issues/9571 that enables setting custom line terminator for CSV writer.
### Describe alternatives you've considered
_No response_
### Additional context
_No response_
Contributor guide
Assessment
This issue has not been assessed yet.