nextcloud / nextcloud/backup

failed restoring points in the appdata directory

Open
#127 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
PHP
Stars
272
Forks
37
PR merge metrics
No merged PRs in 30d

Description

i've had problems with my 100GB disk filling up, while only having 20GB of files.
tonight my nextcloud docker instance got auto-upgraded over night and was defunct in the morning.
i restarted the containers, the disk usage went from 97% to 84% (i guess logs that didn't survive the restart?)

i noticed the backup app folder

34G     data/appdata_xxxxxxxxxxxx/backup

is bigger than my files + db

20G     data/username
8.5G    db

so i had a peek into the backup folder and found:

➜  nextcloud du -hs data/appdata_xxxxxxx/backup/*
24G     data/appdata_xxxxxxxxx/backup/20211217173501-full-znh9ZeZtCJjVCff
2.1G    data/appdata_xxxxxxxxx/backup/20211218200001-differential-q72lubELMj4YJOr
2.2G    data/appdata_xxxxxxxxx/backup/20211219205002-differential-8mkBhNRj8B7bQDf
5.1G    data/appdata_xxxxxxxxx/backup/20211221005002-full-hs5O4HKEXBbuMlD
7.3M    data/appdata_xxxxxxxxx/backup/20211221022502-full-dyV2brPdga1rb3m
7.3M    data/appdata_xxxxxxxxx/backup/20211221024505-full-Z4qTBfsUb42nERs
7.3M    data/appdata_xxxxxxxxx/backup/20211221030501-full-FZbYCgRRN1GSpW1
7.3M    data/appdata_xxxxxxxxx/backup/20211221032501-full-DP8xVJbeClVMUJo
848M    data/appdata_xxxxxxxxx/backup/20211221034035-full-4PBVFXQgrgTKjkz
7.3M    data/appdata_xxxxxxxxx/backup/20211221040001-full-jzAnWuqm7kfTBGW
7.3M    data/appdata_xxxxxxxxx/backup/20211221042003-full-lJ74BLA4MwMyxVt
7.3M    data/appdata_xxxxxxxxx/backup/20211221044008-full-2QP8wd2aIrWto6r
7.3M    data/appdata_xxxxxxxxx/backup/20211221050001-full-Uf5bdzZxfGPro44
7.3M    data/appdata_xxxxxxxxx/backup/20211221052001-full-9Vgan4p9uXshnka
7.3M    data/appdata_xxxxxxxxx/backup/20211221054001-full-uiz4UwGZ6ItAfMQ
7.3M    data/appdata_xxxxxxxxx/backup/20211221060003-full-LImhZWIyQoGTGY4
7.3M    data/appdata_xxxxxxxxx/backup/20211221062001-full-bKmTqbqq3x92gVZ
7.3M    data/appdata_xxxxxxxxx/backup/20211221063502-full-Ertch2wNGuTvbQ1
7.3M    data/appdata_xxxxxxxxx/backup/20211221065009-full-nsWAhQZpmJLTKMp
7.3M    data/appdata_xxxxxxxxx/backup/20211221071002-full-bNT2R3M6yOOrtgO
7.3M    data/appdata_xxxxxxxxx/backup/20211221073002-full-Wz6KSAUGoFS6GNh
7.3M    data/appdata_xxxxxxxxx/backup/20211221075002-full-IExnzCwBVyIOF1L
7.3M    data/appdata_xxxxxxxxx/backup/20211221081001-full-Xqc7165ZvnFTxG9
7.3M    data/appdata_xxxxxxxxx/backup/20211221082501-full-X6JYYLFFJJRgBV8
7.3M    data/appdata_xxxxxxxxx/backup/20211221084502-full-DA8zHuVx3E8CWz3
7.3M    data/appdata_xxxxxxxxx/backup/20211221090510-full-6JixbUTQubi33CI
7.3M    data/appdata_xxxxxxxxx/backup/20211221092506-full-SpcPe2FTrjAJz3f
7.3M    data/appdata_xxxxxxxxx/backup/20211221094501-full-uvjibiiQ1RCK31p
7.3M    data/appdata_xxxxxxxxx/backup/20211221100501-full-Tih7Hxwbojgh1W8
7.3M    data/appdata_xxxxxxxxx/backup/20211221102501-full-UotupR2rY1N1EKF
7.3M    data/appdata_xxxxxxxxx/backup/20211221104501-full-h6ycMVaQfI8ylCN
7.3M    data/appdata_xxxxxxxxx/backup/20211221110002-full-okeU9hnX7BsIbLb
7.3M    data/appdata_xxxxxxxxx/backup/20211221111510-full-5gYJjVXUwIUINRI
7.3M    data/appdata_xxxxxxxxx/backup/20211221113502-full-JAuUySlQikceNls
7.3M    data/appdata_xxxxxxxxx/backup/20211221115004-full-XDQ9e2eSHsaaKoC
7.3M    data/appdata_xxxxxxxxx/backup/20211221121002-full-3wcQAuok7T2n6tx
7.3M    data/appdata_xxxxxxxxx/backup/20211221122502-full-D5oBnW4gdFF5jNe
7.3M    data/appdata_xxxxxxxxx/backup/20211221124515-full-OMdpFJtrre6oshD
7.3M    data/appdata_xxxxxxxxx/backup/20211221171502-full-D9usZMcCQrVu2W3
7.3M    data/appdata_xxxxxxxxx/backup/20211221192502-full-22KwX2bYHxxUZLw
7.3M    data/appdata_xxxxxxxxx/backup/20211221223506-full-vkFcDNIZUlsd6vq
7.3M    data/appdata_xxxxxxxxx/backup/20211222030003-full-Hq4JX7gA6WHTPB9
7.3M    data/appdata_xxxxxxxxx/backup/20211222032001-full-hxteIwzLToEVTv8
7.3M    data/appdata_xxxxxxxxx/backup/20211222034001-full-OiQVFskL8FgWD6E
7.3M    data/appdata_xxxxxxxxx/backup/20211222040002-full-pcxD6oDa3trT3W5
7.3M    data/appdata_xxxxxxxxx/backup/20211222041510-full-VTly3nSi8aYq7ic
7.3M    data/appdata_xxxxxxxxx/backup/20211222043501-full-r2cr3AngABasMye
7.3M    data/appdata_xxxxxxxxx/backup/20211222045501-full-mkVu6Xyn9JbvaNx
7.3M    data/appdata_xxxxxxxxx/backup/20211222051501-full-vxVuWPVtwYU8jDV
7.3M    data/appdata_xxxxxxxxx/backup/20211222053502-full-bSRbE7Xkp5njJ66
7.3M    data/appdata_xxxxxxxxx/backup/20211222055502-full-pde1191SipGA2ed
7.3M    data/appdata_xxxxxxxxx/backup/20211222061002-full-7RklVG883B7B9BJ
7.3M    data/appdata_xxxxxxxxx/backup/20211222062510-full-UOVaIWQlStC4MZg
7.3M    data/appdata_xxxxxxxxx/backup/20211222064502-full-Gjdz25xwntFqFRn
7.3M    data/appdata_xxxxxxxxx/backup/20211222070501-full-citiBHWVt5OKgGc
7.3M    data/appdata_xxxxxxxxx/backup/20211222072003-full-1kNzmmMaNjd8SEp
7.3M    data/appdata_xxxxxxxxx/backup/20211222074002-full-54A9l1PMmOFgInY
7.3M    data/appdata_xxxxxxxxx/backup/20211222080001-full-YfhhPnXGx6HxIvq
7.3M    data/appdata_xxxxxxxxx/backup/20211222082001-full-zXxb9wrXUWlsLMP
7.3M    data/appdata_xxxxxxxxx/backup/20211222084001-full-heXGQhHp3ZWyGsH
7.3M    data/appdata_xxxxxxxxx/backup/20211222090001-full-oEUpAjqGKSWgRcy
7.3M    data/appdata_xxxxxxxxx/backup/20211222092001-full-efNxFH1MVptZgqb
7.3M    data/appdata_xxxxxxxxx/backup/20211222093508-full-C4jiJhUjF5LBD1T
7.3M    data/appdata_xxxxxxxxx/backup/20211222095502-full-htGApOO7uA3cALN
7.3M    data/appdata_xxxxxxxxx/backup/20211222101501-full-uT9mu1mJMWxoDCl
7.3M    data/appdata_xxxxxxxxx/backup/20211222103002-full-4oxhzThXEn3rZzy
7.3M    data/appdata_xxxxxxxxx/backup/20211222105002-full-H92i95kdGcVcge8
7.3M    data/appdata_xxxxxxxxx/backup/20211222110502-full-puoJQLHucMOMFw1
7.3M    data/appdata_xxxxxxxxx/backup/20211222112502-full-RC4X7lsSEyrEQH5
7.3M    data/appdata_xxxxxxxxx/backup/20211222114009-full-rHf69FUrDY9JKhT
7.3M    data/appdata_xxxxxxxxx/backup/20211222120002-full-DB8u9GFoagyo4nJ
7.3M    data/appdata_xxxxxxxxx/backup/20211222122003-full-axDFtveBmhRVEci
7.3M    data/appdata_xxxxxxxxx/backup/20211222124001-full-MRLdfWibpGGc9KL
7.3M    data/appdata_xxxxxxxxx/backup/20211222130001-full-za2yVDlDx1wO4Lf
7.3M    data/appdata_xxxxxxxxx/backup/20211222132001-full-7AQfUvkhcEaQtMm
7.3M    data/appdata_xxxxxxxxx/backup/20211222134004-full-mpSmYEXP9sbGqdX
7.3M    data/appdata_xxxxxxxxx/backup/20211222160009-full-fUYeRxXCk4FWFYu
7.3M    data/appdata_xxxxxxxxx/backup/20211222191510-full-ITTn84BsGh8NOlK
7.3M    data/appdata_xxxxxxxxx/backup/20211222212502-full-dBjTz2cj2tj1DNt
7.3M    data/appdata_xxxxxxxxx/backup/20211223024531-full-FDDwjWAkZz3Stxd

i configured the backup app via the web gui, and set

Limit restoring points creation to the following hours interval: 01:00 and 06:00

Time interval between two full restoring points: 3 days
Time interval between two partial restoring points: 1 day

the web gui also shows me the same as this command:

www-data@1105961a72f4:~/html$ ./occ backup:point:list
- retreiving data from local
 > found RestoringPoint 20211217173501-full-znh9ZeZtCJjVCff
 > found RestoringPoint 20211218200001-differential-q72lubELMj4YJOr
 > found RestoringPoint 20211219205002-differential-8mkBhNRj8B7bQDf
- retreiving data from external:5
 > found RestoringPoint 20211217173501-full-znh9ZeZtCJjVCff
+----------------------------------------------+---------------------+-----------+----------+-------------------------------------+---------+-----------------------------+------------+-----------------+--+
| Restoring Point                              | Date                | NC        | Database | Parent                              | Comment | Status                      | Instance   | Health          |  |
+----------------------------------------------+---------------------+-----------+----------+-------------------------------------+---------+-----------------------------+------------+-----------------+--+
|  20211217173501-full-znh9ZeZtCJjVCff         | 2021-12-17 17:35:01 | 23.0.0.10 | mysql    |                                     |         | packed,compressed,encrypted | local      | 5D, 7H, 31M ago |  |
|                                              |                     |           |          |                                     |         | packed,compressed,encrypted | external:5 | not complete    |  |
|  20211218200001-differential-q72lubELMj4YJOr | 2021-12-18 20:00:01 | 23.0.0.10 | mysql    | 20211217173501-full-znh9ZeZtCJjVCff |         | not packed                  | local      | not checked     |  |
|  20211219205002-differential-8mkBhNRj8B7bQDf | 2021-12-19 20:50:02 | 23.0.0.10 | mysql    | 20211217173501-full-znh9ZeZtCJjVCff |         | not packed                  | local      | not checked     |  |
+----------------------------------------------+---------------------+-----------+----------+-------------------------------------+---------+-----------------------------+------------+-----------------+--+

so is this normal? can i provide more logs from somewhere? i did turn off automatic backup creation for now...

i originally configured everything with external storage (in v1.0.0), after the upgrade to v1.0.3 i configured the appdata to be stored locally. i guess something got messed up? can i just remove & reinstall the app and start fresh?

PS: thanks for the app, i finally backed my stuff up. i dont only want to complain, i really appreciate the work that goes into creating this, thank all of you!

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Review the web GUI backup settings and the ./occ backup:point:list output, comparing local and external restoring points after the v1.0.0-to-v1.0.3 storage change. Gather backup-app logs for the failed or incomplete points; done means explaining whether the extra local points and storage growth are expected and documenting a safe supported recovery path.

Written by the indexing model from the issue text.

Assessment

Tech stack
docker, php
Domain
backend, infrastructure
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.