citusdata / citusdata/citus

Copy on co-located files (e.g., format result) does not honor max_adaptive_executor_pool_size and shared_pool_size

Open
#4,686 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
C
Stars
12.8k
Forks
794
Avg merge
2d 14h
Merged PRs (30d)
31

Description

Once we fix #4673, Copy on co-located files (e.g., format result) does not honor max_adaptive_executor_pool_size and shared_pool_size.

We have to improve it. Some earlier ideas:
- we could consider introducing a new style of COPY that appends
- or explicitly generate multiple files and read from multiple files

Contributor guide

Open the contributing guide

Research direction

Start by reviewing issue #4673 and the COPY path for co-located files such as format results. Determine how max_adaptive_executor_pool_size and shared_pool_size are currently bypassed, then settle whether completion means append-style COPY or explicitly generated multiple files that can be read together.

Written by the indexing model from the issue text.

Assessment

Tech stack
c, postgresql
Domain
databases, distributed-systems
Issue type
Bug
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.