citusdata / citusdata/citus

Make Metadata Sync Work on Background Executor

Open
#6,935 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
C
Stars
12.8k
Forks
794
Avg merge
2d 14h
Merged PRs (30d)
31

Description

Metadata sync can take several hours for large clusters and database session should be kept open during its execution to finish. This is bad since if the session closes somehow, the operation would not complete. (even worse if citus.metadata_sync_mode = 'nontransactional', which leaves the cluster at an inconsistent state)

As solution we can make use of background executor, which will retry the operation from failed state.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.