cockroachdb / cockroachdb/cockroach
export: set upper bound on chunk_size/chunk_rows
Open
A-cdc
C-enhancement
O-support
P-3
T-cdc
- Dominant language
- Go
- Stars
- 32.5k
- Forks
- 4.1k
- PR merge metrics
- PR metrics pending
Description
We should set an upper bound on `chunk_size`/`chunk_rows` to prevent files from becoming so large that they cause downstream problems.
Informed by https://github.com/cockroachlabs/support/issues/3170
Jira issue: CRDB-46950
Contributor guide
Research direction
Start by locating the export implementation and the handling of chunk_size and chunk_rows, then inspect any related tests. Review the linked support issue for the downstream file-size problem and determine an appropriate upper bound; done means oversized exports are prevented and the behavior is covered by tests.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- go
- Domain
- database
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100