apache/paimon

View on GitHub

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.

Stars: 3.4k
Forks: 1.4k
Open beginner issues: 0
Indexed issues: 649
Avg merge: 1d 11h
Merged PRs (30d): 396

Dominant language: Java
License: Apache-2.0
Last GitHub push: Sep 17, 2026
Latest indexed: Sep 14, 2026
Contributing guide: No contributing guide
Code of conduct: Code of conduct
Beginner labels: good first issue help wanted

Open All

645 open issues indexed

[Feature] Support periodically refresh existing dataFileMetas in CompactManager Open

enhancement

apache/paimon#5213 · 4 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Feature] Support periodically refresh current levels in MergeTreeCompactManager Open

enhancement

apache/paimon#5214 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Feature] Support periodically refresh toCompact dataFileMetas in BucketedAppendCompactManager Open

enhancement

apache/paimon#5215 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug] parquet java version has a logging bug when debug logging is turned on Open

bug

apache/paimon#5231 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Feature] Support scala version profile Open

enhancement

apache/paimon#5252 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Feature] Support to include partition in the outputPartition Open

enhancement

apache/paimon#5293 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Test][spark] Unstable test Paimon migrate file procedure: migrate avro non-partitioned table Open

bug

apache/paimon#5307 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug] lookup with retry is very slow if there are equality in a where clause after the join Open

bug

apache/paimon#5311 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[help] Using Java-API to implement incremental reading between Snapshots Open

enhancement

apache/paimon#5344 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Feature] Update Flink dependency to 2.0 Open

enhancement

apache/paimon#5350 · 7 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug] Sequence group may cause record in wrong state. Open

bug

apache/paimon#5387 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug] CDC MySQL data to Paimon using PaimonAction. Exception: AvroRuntimeException: Unrecognized codec: snappy Open

bug

apache/paimon#5395 · 7 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[enhancement ] Reusing the lengths array in ArrowFieldWrites$ArrayWriter's doWrite method Open

enhancement

apache/paimon#5401 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[enhancement] Logging Optimization Open

enhancement

apache/paimon#5432 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug] Failed to finish checkpoint due to the expection: 'Failed to read 4 bytes' Open

bug

apache/paimon#5434 · 8 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Feature] Add support of pluggable Hash function for paimon bucket Open

enhancement

apache/paimon#5436 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug] throw Hive DDL and paimon schema mismatched excetion when show the table's schema with the timestamp type Open

bug

apache/paimon#5450 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug] compact_database StreamingCompactorSource Busy(max) 100% Open

bug

apache/paimon#5463 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug] 0.9.0 When querying the paimon table in Parquet format through starrocks, the following error appears. I tried to adjust the heap memory size, but it still works like this Open

bug

apache/paimon#5469 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug][spark]java.lang.ArrayIndexOutOfBoundsException Open

bug

apache/paimon#5498 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Feature] improve orc and parquet file reading using arrow Open

enhancement

apache/paimon#5503 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Feature] Introduce Archive ability Open

enhancement

apache/paimon#5510 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Feature] Enhance return result for procedure Open

enhancement

apache/paimon#5511 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug] java.lang.IllegalStateException: Number of files stored in Levels does not equal to the size of inputFiles. This is unexpected. Open

bug

apache/paimon#5524 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug] Paimon CDC not working in Dynamic Bucket Mode Open

bug

apache/paimon#5534 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Where do we get the release notes for 1.1.0? Open

enhancement

apache/paimon#5543 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug] error in initSerDe: java.lang.ClassNotFoundException Class org.apache.paimon.hive.PaimonSerDe not found Open

bug

apache/paimon#5555 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Feature] Log scene specialized index Open

enhancement

apache/paimon#5558 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug] The Hive connector encounters time offset issues when reading and writing data of the timestamp with local time zone field type. Open

bug

apache/paimon#5568 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug] flinksql two sinks can't define parallelism Open

bug

apache/paimon#5635 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Feature] Add SinkV2 implementation for Paimon Flink Sink. Open

enhancement

apache/paimon#5647 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug] Decimal Value Corruption in Batch Write (Values Shifted Incorrectly) Open

bug

apache/paimon#5656 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Feature] Support inheriting snapshot properties during Paimon compaction Open

enhancement

apache/paimon#5664 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Feature] Reuse RocksDB in FullCacheLookupTable Open

enhancement

apache/paimon#5672 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug] paimon-0.9版本自行编译，执行action 报Implementing class 异常 Open

bug

apache/paimon#5677 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug] InterruptedException when using Spark Compact Procedure paimon table with snapshot.expire.execution-mode=async Open

bug

apache/paimon#5681 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Feature] The multiple partition min-max predicate may lead to regression in partition filter Open

enhancement

apache/paimon#5683 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug] The scan.timestampmillis parameter is not effective Open

bug

apache/paimon#5720 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug] timestamp reading from paimon is different from hive after hive-cloning Open

bug

apache/paimon#5722 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Feature] support bucket join when the table has same bucket function type Open

enhancement

apache/paimon#5723 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug] Lookup Changlog with "row-deduplicate=true" lost data Open

bug

apache/paimon#5724 · 4 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug] compact performance Open

bug

apache/paimon#5741 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug] cosn FileSystem plugin jar error Open

bug

apache/paimon#5749 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Discuss] Paimon datalake for AI training Open

enhancement

apache/paimon#5761 · 1 comment · 4 reactions · 0 assignees · Indexed Sep 14, 2026
[Feature] Hope to retrieve FileStoreTable information via HMS in SparkSource#loadTable. Open

enhancement

apache/paimon#5770 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug] The Spark query on Paimon consumes a relatively large amount of memory, and there are also errors in field type conversion. Open

bug

apache/paimon#5773 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug] The directory item limit of index is exceeded Open

bug

apache/paimon#5788 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug] flink compact_database cannot feel table schema change Open

bug

apache/paimon#5791 · 5 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug] Hudi Migration to Paimon Possible Open

bug

apache/paimon#5818 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[Bug] set consumner-id, but still error with "snapshot with id has expired." Open

bug

apache/paimon#5819 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026

apache/paimon

Get new issues in your inbox