apache / apache/arrow

[Python] Read table stuck and hangs forever

Open
#37,139 13 comments 0 reactions 0 assignees View on GitHub
Component: Parquet Component: Python Type: bug
Dominant language
C++
Stars
17.1k
Forks
4.3k
Avg merge
3d 13h
Merged PRs (30d)
88

Description

### Describe the bug, including details regarding any error messages, version, and platform.

It happens in version 11.0.0, 12.0.1

File is parquet file and it is being read from the s3 directly.
The parquet file size is 1.4 GB.

Here is the code:
batch size is 5000

for batch in pq.read_table("bucket_path", filesystem=self.s3_file_system).to_batches(batch_size)

It stucks and there is no exception or anything.

### Component(s)

Parquet, Python

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.