Investigate sockets being in TIME_WAIT with several parallel COPYs
Open
- Dominant language
- C
- Stars
- 12.8k
- Forks
- 794
- Avg merge
- 2d 14h
- Merged PRs (30d)
- 31
Description
When we run several parallel short COPYs on hash distributed tables, we saw errors which said that ports were not available for establishing connections for COPY. Note that the number of connections were still lower than the max_connections parameter on the worker nodes.
This is likely because of many sockets being in TIME_WAIT. We enabled tcp_tw_reuse and tcp_tw_recycle, and set tcp_fin_timeout to 30 but that still didn't resolve the issue.
We should investigate further to understand the cause of this.
@anarazel : Please feel free to add anything I may have missed.
Contributor guide
Assessment
This issue has not been assessed yet.