cloudnative-pg / cloudnative-pg/plugin-barman-cloud

Base backups are single-threaded and ignore concurrency settings

Aperta
#906 0 commenti 0 reazioni 0 assegnatari Vedi su GitHub
bug
Lingua principale
Go
Stelle
191
Fork
72
Merge medio
2g 21h
PR unite (30g)
21

Descrizione

The `plugin-barman-cloud` performs base backups using a single upload stream. Unlike WAL archiving (which supports `maxParallel`), there is no way to parallelize the data backup phase. This results in bottlenecks for large databases.

This option:
```
$ kubectl explain objectstore.spec.configuration.data.jobs
GROUP: barmancloud.cnpg.io
KIND: ObjectStore
VERSION: v1

FIELD: jobs

DESCRIPTION:
The number of parallel jobs to be used to upload the backup, defaults
to 2
```
is not applicable due to limitation (only for rsync):
https://github.com/EnterpriseDB/barman/blob/ff040cd1feee805da3e4662a187c583f8730dfab/docs/user_guide/configuration.rst?plain=1#L336

> parallel_jobs

> Controls the number of parallel workers used to copy files during backup or recovery.
It must be a positive integer. Default is ``1``.

> note::
> Applies only when ``backup_method = rsync``.

Guida per i contributori

Apri la guida per i contributori

Direzione di ricerca

Start by tracing the plugin-barman-cloud base-backup upload path and compare it with WAL archiving's maxParallel handling. Determine how the data upload can honor a configurable parallel-job setting; done means the base backup phase supports parallel uploads without changing the existing default behavior.

Scritto dal modello di indicizzazione a partire dal testo della issue.

Valutazione

Stack tecnologico
go, postgresql
Ambito
cloud, databases, performance
Tipo di issue
Funzionalità
Difficoltà
4/5
Tempo stimato
3-5 giorni
Stato di attività
Tranquilla
Chiarezza
Abbastanza chiara
Idoneità per principianti
52/100

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.