citusdata / citusdata/citus

Make COPY tolerant to connection timeouts if connections exist

Open
#4,113 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
C
Stars
12.8k
Forks
794
Avg merge
2d 14h
Merged PRs (30d)
31

Description

We sometimes see connection timeouts during COPY, which causes the whole COPY to abort. However, if we already have an active connection to the worker node we could reuse that connection instead of establishing a new one.

Contributor guide

Open the contributing guide

Research direction

Start by tracing the COPY path that establishes connections to worker nodes, then inspect how existing active connections are tracked and selected. Reproduce or locate coverage for a connection timeout during COPY; done means an available active connection is reused instead of aborting the COPY.

Written by the indexing model from the issue text.

Assessment

Tech stack
c, postgresql
Domain
backend, databases, distributed-systems
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.