Optionally Disable CSV Null Regex

Hello,

I'm writing to you on the advice of Dominik Moritz who create a tool named CSV2Parquet. I contacted him first because I'm using his tool. And if I understood it well, he told me that his tool is using the "arrow-rs parser".

My issue is the following : when I'm transforming a CSV file into a Parquet file, I can't store an empty string into the Parquet file.
- If I enter nothing between two commas, it counts it as a NULL value.
- If I enter "", it counts it as a NULL value too.

Having the ability to store a NULL value is good. But I would like to be able to store an empty string too.

Is this feature existing already, and if yes, what must I enter between two commas?
Or is it an evolution, and will you add it? If yes, do you have an rough idea about when? (month or year to come)

Best regards,

Anthony Piron

Start by tracing the arrow-rs CSV parser's handling of empty fields and quoted empty strings, then review the existing issue discussion for the intended distinction between NULL and empty values. A complete change should provide an optional way to preserve empty strings while retaining current NULL behavior, with tests covering both CSV forms.

Written by the indexing model from the issue text.