cockroachdb / cockroachdb/cockroach

export: deprecate EXPORT

Open
#105,297 1 comment 0 reactions 0 assignees View on GitHub
A-cdc C-enhancement T-cdc
Dominant language
Go
Stars
32.5k
Forks
4.1k
PR merge metrics
PR metrics pending

Description

EXPORT causes problems at a high scale. We've been recommending for a while changefeeds over export. Unfortunately, we're still seeing frequent escalations, such as [this one](https://github.com/cockroachlabs/support/issues/2379). It would take a large investment in EXPORTs to make them more stable, inclusing adding memory monitoring and porting many of the checkpointing, compression, obs logic over from changefeeds. We are not going to make this investment.

We should do one or several of:
1) Deprecate EXPORT - put a deprecation notice in the docs and when you try to use export, notify you
2) When an EXPORT is initiated, check the number of ranges, disallow over a certain threshold (5000 ranges is the suggested threshold, could also be a cluster setting.

My recommendation is we do both

Jira issue: CRDB-28969

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.