googleapis / googleapis/google-cloud-python

support the Arrow PyCapsule Interface without a pyarrow dependency

Đang mở
#15,699 3 bình luận 3 reaction 1 người được giao Được @tswast nhận Xem trên GitHub
api: bigquery
Ngôn ngữ chính
Python
Star
5.4k
Fork
1.8k
Merge trung bình
3 ngày 4 giờ
Pull request đã merge (30 ngày)
122

Mô tả

**Is your feature request related to a problem? Please describe.**

The polars community uses the arrow in-memory format without a need for a dependency on the heavy weight pyarrow package, but the easiest way to get arrow out of and into BigQuery with this client requires the use of the pyarrow dependency.

**Describe the solution you'd like**

Expose the Arrow PyCapsule Interface on RowIterator (returned by QueryJob.result(), Client.query_and_wait(), Client.list_rows()). This functionality should not require pyarrow. See: https://gist.github.com/tswast/99b017b20386e324f5c7d2bd49f21b5f for a related example of how this could be done.

**Describe alternatives you've considered**

* Separate package exposing the Arrow PyCapsule Interface
* Always require pyarrow
* Directly integrate into polars (in-progress)

**Additional context**

* [[Python] Promote usage of the Arrow PyCapsule Protocol (for the C Data Inteface) #39195](https://github.com/apache/arrow/issues/39195)
* [support adbc APIs in DB-API package](https://github.com/googleapis/python-bigquery/issues/2015#top)
* [Support inserting data into BigQuery directly from a Polars DataFrame](https://github.com/googleapis/google-cloud-python/issues/15710#top)

Hướng dẫn đóng góp

Mở hướng dẫn đóng góp

Đánh giá

Issue này chưa được đánh giá.

Nhận issue mới trong hộp thư của bạn

Bản tóm tắt ngắn những issue GitHub phù hợp với người mới.