apache/iceberg-python

View on GitHub

PyIceberg

Stars: 1.1k
Forks: 581
Open beginner issues: 0
Indexed issues: 143
Avg merge: 1d 17h
Merged PRs (30d): 78

Dominant language: Python
License: Apache-2.0
Last GitHub push: Sep 13, 2026
Latest indexed: Sep 14, 2026
Contributing guide: No contributing guide
Code of conduct: Code of conduct
Beginner labels: good first issue

Open All

141 open issues indexed

PyArrowFile class is not compatible with ABFS uri syntax Open

apache/iceberg-python#2698 · 7 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Enable stats collection for nested fields and use write.metadata.metrics.max-inferred-column-defaults to control stats growth Open

apache/iceberg-python#2699 · 4 comments · 5 reactions · 0 assignees · Indexed Sep 14, 2026
Allow to assume role when connecting to AWS catalogs (glue/dynamodb) Open

apache/iceberg-python#2747 · 3 comments · 1 reaction · 0 assignees · Indexed Sep 14, 2026
Add Server-Side Scan Planning Support Open

apache/iceberg-python#2775 · 5 comments · 5 reactions · 1 assignee · Indexed Sep 14, 2026
try IRC backed by HMS Open

apache/iceberg-python#2781 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
S3FileSystem.close_session raise "attached to a different loop" Open

apache/iceberg-python#2785 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add `delete_files` Open

apache/iceberg-python#2787 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
DataFile Serialization for REST Scan Planning Open

apache/iceberg-python#2792 · 4 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Expression parser docs and pyparsing notes Open

apache/iceberg-python#2860 · 4 comments · 4 reactions · 0 assignees · Indexed Sep 14, 2026
feat: refactor rest signer in fileio Open

apache/iceberg-python#2862 · 4 comments · 2 reactions · 0 assignees · Indexed Sep 14, 2026
Retry Behavior for SigV4Adapter in REST Catalog Open

apache/iceberg-python#3008 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
refactor Config() and _ENV_CONFIG Open

apache/iceberg-python#3028 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
ArrowScan materializes entire FileScanTask into memory Open

stale

apache/iceberg-python#3036 · 6 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Databricks Iceberg REST catalog doesn't support multiple snapshots per transaction Open

apache/iceberg-python#3076 · 1 comment · 1 reaction · 0 assignees · Indexed Sep 14, 2026
Expression constructors are not mypy-compatible without the pydantic plugin Open

apache/iceberg-python#3101 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Upsert fails after update_schema().union_by_name() due to schema mismatch Open

apache/iceberg-python#3105 · 3 comments · 2 reactions · 0 assignees · Indexed Sep 14, 2026
Add option to pass storage config to polars lazy read Open

apache/iceberg-python#3128 · 3 comments · 3 reactions · 0 assignees · Indexed Sep 14, 2026
Upsert with 1M rows extremely slow due to `create_match_filter` and `txn.delete()` performance Open

apache/iceberg-python#3129 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Feature: Add metadata-only replace API to Table for REPLACE snapshot operations Open

apache/iceberg-python#3130 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Support DIGEST-MD5 / delegation token authentication for HMS Open

stale

apache/iceberg-python#3145 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Bug: dynamic_partition_overwrite silently skips spec-0 manifests after partition spec evolution Open

stale

apache/iceberg-python#3148 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
load_table consumes enormous amounts of memory on large metadata file Open

apache/iceberg-python#3162 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
s3 enpoint url in table.io.properties is different than that of catalog.properties Open

stale

apache/iceberg-python#3163 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
`Table.scan(options=...)` silently ignores S3 properties for FileIO during data materialization (`to_pandas` / `to_arrow`) Open

apache/iceberg-python#3166 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
When pyiceberg loads Iceberg tables containing large JSON data into memory, memory usage explodes in pyarrow Open

apache/iceberg-python#3168 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Replace medics-material Open

apache/iceberg-python#3188 · 1 comment · 1 reaction · 0 assignees · Indexed Sep 14, 2026
Feature Request: Encryption Open

apache/iceberg-python#3222 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add Tencent Cloud COS (cosn://, cos://) FileIO support via fsspec Open

apache/iceberg-python#3239 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Cross account lakeformation tables in AWS Open

apache/iceberg-python#3244 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Discrepency in the fetched table properties Open

apache/iceberg-python#3247 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
fails to compile on systems with GCC newer than 12.x Open

apache/iceberg-python#3259 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
ArrowScan to_table fails if the data is mixed between dict-encoded strings and plain strings. Open

apache/iceberg-python#3260 · 1 comment · 1 reaction · 0 assignees · Indexed Sep 14, 2026
Performance monitoring of manifest cache Open

apache/iceberg-python#3266 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Equality Delete support Open

apache/iceberg-python#3270 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Failed to sign request 412 - Expect: ['100-continue'] Open

apache/iceberg-python#3291 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Support Python 3.14 free-threaded Open

apache/iceberg-python#3322 · 0 comments · 1 reaction · 0 assignees · Indexed Sep 14, 2026
Add integration test for 'overwrite' option in register_table Open

apache/iceberg-python#3325 · 2 comments · 2 reactions · 0 assignees · Indexed Sep 14, 2026
SqlCatalog table operations should filter on `iceberg_type` Open

apache/iceberg-python#3337 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Implement iterator to lazily go through the paged response Open

apache/iceberg-python#3365 · 6 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
fix(streaming-write): use rolling ParquetWriter + OutputStream.tell() for spec-correct file sizes and bounded memory Open

apache/iceberg-python#3388 · 0 comments · 1 reaction · 0 assignees · Indexed Sep 14, 2026
refactor sigv4 out of rest catalog Open

apache/iceberg-python#3410 · 1 comment · 1 reaction · 0 assignees · Indexed Sep 14, 2026
Bug: REST catalog auth cannot be configured via environment variables unless auth JSON strings are decoded Open

apache/iceberg-python#3422 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Windows ARM64 wheel support Open

apache/iceberg-python#3473 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Visitor and evaluator edge cases can over-prune files or mishandle nulls Open

apache/iceberg-python#3498 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
feat: Automatic Vended Credential Refresh Open

apache/iceberg-python#3506 · 0 comments · 1 reaction · 0 assignees · Indexed Sep 14, 2026
Segfault on large multi-column Iceberg upserts Open

apache/iceberg-python#3508 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
v1 Breaking Changes Open

apache/iceberg-python#3542 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add explicit truthiness semantics for constant BooleanExpressions Open

apache/iceberg-python#3543 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Integrate DataFusion as execution engine for compute-heavy operations Open

apache/iceberg-python#3554 · 11 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
add_files support parquet files with field ids Open

apache/iceberg-python#3556 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026

apache/iceberg-python

Get new issues in your inbox