apache/paimon

View on GitHub

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.

Stars: 3.4k
Forks: 1.4k
Open beginner issues: 0
Indexed issues: 649
Avg merge: 1d 11h
Merged PRs (30d): 396

Dominant language: Java
License: Apache-2.0
Last GitHub push: Sep 17, 2026
Latest indexed: Sep 14, 2026
Contributing guide: No contributing guide
Code of conduct: Code of conduct
Beginner labels: good first issue help wanted

Open All

645 open issues indexed

[Feature] Support for Repair Procedure for JDBC catalog Open

enhancement

apache/paimon#7287 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug] two fixed bucket pk table join to fixed bucket table cause low performance Open

bug

apache/paimon#7385 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Feature] Expose Flink Source in FlinkSourceBuilder API Open

enhancement

apache/paimon#7395 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Feature] Support table properties in jdbc metastore Open

enhancement

apache/paimon#7421 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug] upgrade Jackson due to security hardening fixes Open

bug

apache/paimon#7431 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Feature] Add key->filename system table and support batch/streaming read Open

enhancement

apache/paimon#7438 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Feature] Add filename->manifest entry system table and support batch/streaming read Open

enhancement

apache/paimon#7440 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug] OSS access timed out during the transaction commit phase, resulting in the failure of a long-running Spark write job Open

bug

apache/paimon#7459 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug] [core] changing 'dynamic-bucket.initial-buckets' on existing tables should be forbidden Open

bug

apache/paimon#7490 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Feature] when using chain table , not all partition key should be used to fallback and filter data Open

enhancement

apache/paimon#7503 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug] using Chain table group partition ,partition in snapshot but not in delta will not be read Open

bug

apache/paimon#7532 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Support] Checkpoint cannot complete when Flink reads the full data of a table in streaming mode. Open

bug

apache/paimon#7541 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug] kafka_sync_database can only auto create one table per topic. Open

bug

apache/paimon#7581 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Feature] Support manage AI model in catalog Open

enhancement

apache/paimon#7582 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Feature] Add lastCommittedSnapshotId commit metric and document lastScannedSnapshotId scan metric Open

enhancement

apache/paimon#7588 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Feature] Support DelegatingCatalogExtension in Paimon SparkCatalog for unified catalog integration Open

enhancement

apache/paimon#7629 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Feature] Paimon commit metrics are not exposed via Spark's MetricsSystem for external monitoring (JMX/Prometheus) Open

enhancement

apache/paimon#7646 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Feature] Support Variant type for PyPaimon Open

enhancement

apache/paimon#7655 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[core][bug]Default IOManagerImpl does not clean spill folders in tempDirs when write-buffer-spillable=true Open

bug

apache/paimon#7664 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Feature] Chained tables should allow set fallback rules for non-existent partitions. Open

enhancement

apache/paimon#7682 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Feature] Dependency conflict: pypaimon 1.3.1 pins pyarrow==16 Open

enhancement

apache/paimon#7685 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug] Saving dataframe in overwrite mode using Spark doesn't set primary key Open

bug

apache/paimon#7687 · 4 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug] remove_orphan_files may accidentally delete data in multitasking concurrent scenarios Open

bug

apache/paimon#7710 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Feature] Generating changelogs with Python writers for input changelog-producer Open

enhancement

apache/paimon#7733 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Feature] PyArrowFileIO handling for Google Cloud Storage Open

enhancement

apache/paimon#7768 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug] Use Paimon Catalog in StarRocks to access data on OBS report error "UnsupportedSchemeException" Open

bug

apache/paimon#7835 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug] Kafka Debezium Avro deserialization uses wrong schema subject for multi-topic sources Open

bug

apache/paimon#7859 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Feature] Support Parquet map shredding for hot key columns Open

enhancement

apache/paimon#7876 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[WIP][Feature] Logical Partition Coalescing with Physical Partition Mapping Open

enhancement

apache/paimon#7880 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug] TIMESTAMP(9) write to PostponeBucketTable fails with 'file.format.per.level' = '0:avro' Open

bug

apache/paimon#7883 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Feature] Support to order data by keys in append only writer Open

enhancement

apache/paimon#7885 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug][Flink] 'scan.parallelism' cannot be scoped to source because PaimonDataStreamScanProvider does not override ParallelismProvider#getParallelism() Open

bug

apache/paimon#7905 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug] Partition expiration stuck in infinite failure loop when HMS drop succeeds but Paimon drop fails due to unhandled MetaException Open

bug

apache/paimon#7964 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[feature] Enhance COPY INTO with multi-format support and advanced options Open

apache/paimon#8005 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Feature] Migrate PyPaimon packaging to pyproject.toml Open

enhancement

apache/paimon#8049 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug] `requirements-dev.txt` misses dependencies needed for local Python tests Open

bug

apache/paimon#8082 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Feature] Download remote index files when already built Open

enhancement

apache/paimon#8123 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug] RemoteTableQuery keySerializer should not include partition keys Open

bug

apache/paimon#8145 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Feature] [core] Support arbitrary time granularity for chain table delta computation Open

enhancement

apache/paimon#8184 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug] Lookup changelog producer with deletion vectors can permanently diverge CDC consumers: re-insert after delete produces no changelog Open

apache/paimon#8204 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Feature] PIP-30: Introduce coordinator-based commit for Flink sink Open

enhancement

apache/paimon#8220 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Feature] TrinoSplitManager calls dropStats() before scan planning, preventing manifest-level file pruning Open

enhancement

apache/paimon#8257 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug] S3 snapshot commit requires ListBucket due to missing-object status checks Open

apache/paimon#8261 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug] JDBC Connection Leak in Paimon when Flink job restarts Open

bug

apache/paimon#8267 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Feature] Support Deletion Vector for Data Evolution Tables Open

enhancement

apache/paimon#8322 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Feature] Support per-partition bucket counts in the Spark writer (fixed-bucket tables) Open

enhancement

apache/paimon#8349 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Feature] Add `replace` parameter to `create_global_index` procedure Open

apache/paimon#8415 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug] Iceberg manifest file does not conform to spec due to missing Avro metadata Open

bug

apache/paimon#8440 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Feature] skip table lookup for meta-columns-only vector search Open

enhancement

apache/paimon#8484 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Feature] Flink 2.2 supports Paimon 1.3.1 Open

enhancement

apache/paimon#8490 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026

apache/paimon

Get new issues in your inbox