cockroachdb / cockroachdb/cockroach
backup: storage optimizations for large descriptorslist.sst
Open
A-disaster-recovery
C-bug
C-performance
P-3
T-disaster-recovery
- Dominant language
- Go
- Stars
- 32.5k
- Forks
- 4.1k
- PR merge metrics
- PR metrics pending
Description
We currently store the entire descriptor protobufs in the `descriptorlist.sst` file in a backup. In our 100k/1M descriptor testing, this results in fairly large `descriptorlist.sst` files, which slows down backup execution, even for backups of empty schemas. We should investigate potential areas of improvements here (for example, seeing if any fields can be nil'd out before writing to the backup).
Jira issue: CRDB-64358
Epic CRDB-62562
Contributor guide
Assessment
This issue has not been assessed yet.