Time partitions seemingly breaking themselves at random on distributed tables.
- Dominant language
- C
- Stars
- 12.8k
- Forks
- 794
- Avg merge
- 2d 14h
- Merged PRs (30d)
- 31
Description
We've been working with citus distributed and partitionned tables for a few weeks now, and some partitions broke at random on distributed tables. This makes the table unable to run a query without time constraints, or just on the partition :

This does not happen for the neighboring partitions :

And only happens on one of our worker nodes (w1) :

Apparently, the partition randomly lost 8KB of data according to citus_tables and citus_total_relation_size :


This already happened three times (as we know of) on two distinct tables.
The broken partitions are January 2025 and November 2027 on the first table and March 2027 on the second table.
We know that the partition on the second table broke on March 19th of this year.
We are using the Azure Cosmos DB for PostgreSQL Cluster to host the database.
Any help to recover/repair these partitions are greatly appreciated because our current solution is to drop the partition and regenerate it with create_time_partitions.
Contributor guide
Assessment
This issue has not been assessed yet.