cockroachdb / cockroachdb/cockroach

cdc: Incorrect/outdated changefeed limitations section

Open
#114,644 1 comment 0 reactions 0 assignees View on GitHub
A-cdc A-docs C-bug T-cdc
Dominant language
Go
Stars
32.5k
Forks
4.1k
PR merge metrics
PR metrics pending

Description

Stumbled upon known limitations page
https://www.cockroachlabs.com/docs/v23.1/create-and-configure-changefeeds#known-limitations,
and noticed that we have few out of date limitations listed there:

* `Webhook sinks only support emitting JSON. Tracking GitHub Issue` — that’s not true; CSV also supported
* `There is no concurrency configurability for webhook sinks. Tracking GitHub Issue` — not true, we have changefeed.sink_io_workers setting to control this.
* `Using a cloud storage sink only works with JSON and emits newline-delimited json files. Tracking GitHub Issue` — CSV and Parquet also supported.
* `If a changefeed with on_error='pause(https://www.cockroachlabs.com/docs/v23.1/create-changefeed#on-error) is running when a watched table truncated ... angefeed will pause but will not be able to resume reads from that table.`... I'm not sure it's a limitation; I think it's working as intended. Perhaps this whole on_error=pause should be deprecated/removed.
*

Jira issue: CRDB-33610

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.