zalando / zalando/postgres-operator

Dump size coef=5 is won't always work.

Open
#1,821 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Go
Stars
5.2k
Forks
1.1k
Avg merge
2d 16h
Merged PRs (30d)
3

Description

https://github.com/zalando/postgres-operator/blob/38db48c7f085be6834a626d496d5bdece62f8a9d/docker/logical-backup/dump.sh#L11

Logical backup script assumes that the compressed stream of the backup is 1/5 the size of the raw dump. This is not always true, and I was having an issue with a >400Gb backup. I've tested setting it to 3 for this exact job, which works. Will come a PR for this soon.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with docker/logical-backup/dump.sh at line 11 and inspect how the backup size is estimated from the raw dump. Compare the reported coefficient-3 result with the current coefficient-5 assumption; done means large logical backups are sized reliably rather than failing because the fixed compression ratio is inaccurate.

Written by the indexing model from the issue text.

Assessment

Tech stack
postgresql, shell
Domain
databases
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
32/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.