[Python] Pyarrow csv reader : ability to specify a max number of rows to read
Open
Component: Python
Type: enhancement
- Dominant language
- C++
- Stars
- 17.1k
- Forks
- 4.3k
- Avg merge
- 3d 13h
- Merged PRs (30d)
- 88
Description
### Describe the enhancement requested
Exactly as in the title :
The ability for Pyarrow csv reader to specify a max number of rows to read.
it's possible with other engines on Pandas but not with pyarrow. (see nrows)
https://pandas.pydata.org/docs/dev/reference/api/pandas.read_csv.html
And as a general enhancement, covering all the pandas option would be great
Edit : note that also exists on Polars : https://docs.pola.rs/api/python/dev/reference/api/polars.read_csv.html
Best regards,
Simon
### Component(s)
Python
Contributor guide
Assessment
This issue has not been assessed yet.