[Python] Allow specifying CacheOptions in ParquetFile and IpcReadOptions
Open
Component: Python
good-first-issue
- Dominant language
- C++
- Stars
- 17.1k
- Forks
- 4.3k
- Avg merge
- 3d 13h
- Merged PRs (30d)
- 88
Description
As a follow-up on https://github.com/apache/arrow/pull/36627, which exposed the `CacheOptions` in PyArrow, and added support for specifying it in the arrow reader properties in `_dataset_parquet.pyx`:
* The ArrowReaderProperties are also used in `_parquet.pyx` (for ParquetReader, which backs `pq.ParquetFile(..)`). Ideally we keep the single file reader functionalities equivalent with the dataset reader (for pure parquet things), and so we can expose this option there as well.
* We can also add this as a configurable parameter to `IpcReadOptions` bindings.
Contributor guide
Assessment
This issue has not been assessed yet.