cockroachdb / cockroachdb/cockroach

importer: refine how we generate splits for import spans

Open
#159,407 0 comments 0 reactions 0 assignees View on GitHub
A-import C-enhancement T-sql-foundations
Dominant language
Go
Stars
32.5k
Forks
4.1k
PR merge metrics
PR metrics pending

Description

Import processor planning contains the following TODO item that is unresolved:

> TODO(jeffswenson): this isn't complete. We don't actually want to
> generate splits for each index. What we want to do is generate splits
> for each span config produced by the table that does not coalesce. For
> example, a single RBR index would get split points between each of the
> ranges.
>
> We should also consider making bulkingest tolerate ingesting an SST
> that has data for multiple ranges. At the very least that will handle
> the case where KV decides to run splits we were not expecting.

This issue tracks discussion and resolution of that item.

Jira issue: CRDB-57830

Epic CRDB-62564

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.