apache / apache/arrow

[Python] Allow specifying CacheOptions in ParquetFile and IpcReadOptions

Open
#39,530 3 comments 0 reactions 1 assignee Claimed by @josechudev View on GitHub
Component: Python good-first-issue
Dominant language
C++
Stars
17.1k
Forks
4.3k
Avg merge
3d 13h
Merged PRs (30d)
88

Description

As a follow-up on https://github.com/apache/arrow/pull/36627, which exposed the `CacheOptions` in PyArrow, and added support for specifying it in the arrow reader properties in `_dataset_parquet.pyx`:

* The ArrowReaderProperties are also used in `_parquet.pyx` (for ParquetReader, which backs `pq.ParquetFile(..)`). Ideally we keep the single file reader functionalities equivalent with the dataset reader (for pure parquet things), and so we can expose this option there as well.
* We can also add this as a configurable parameter to `IpcReadOptions` bindings.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.