apache / apache/arrow

[Python] Pyarrow csv reader : ability to specify a max number of rows to read

Open
#48,695 0 comments 1 reaction 0 assignees View on GitHub
Component: Python Type: enhancement
Dominant language
C++
Stars
17.1k
Forks
4.3k
Avg merge
3d 13h
Merged PRs (30d)
88

Description

### Describe the enhancement requested

Exactly as in the title :
The ability for Pyarrow csv reader to specify a max number of rows to read.

it's possible with other engines on Pandas but not with pyarrow. (see nrows)
https://pandas.pydata.org/docs/dev/reference/api/pandas.read_csv.html

And as a general enhancement, covering all the pandas option would be great

Edit : note that also exists on Polars : https://docs.pola.rs/api/python/dev/reference/api/polars.read_csv.html

Best regards,

Simon

### Component(s)

Python

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.