nextcloud / nextcloud/nextcloudpi

not possible to restore nc instance

Open
#1,658 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

has-updates
Dominant language
Shell
Stars
2.9k
Forks
318
No merged PRs in 30d

Description

Hello, i am unable to restore a previously backed up nc instance, i use the docker container(latest ofc) and when i try to import my data via previously created .tar backup file (around 22Gb) it starts to extract the files (at least it says this) and then it consumes more and more ram, uses every ram including the swap memory and then the entire server crashes because its running out of ram(i have 4Gb ram total) below is the output of sudo ncp-report i havent changed any of the stock docker configuration so it should be easy to reproduce :)

<--! Paste this in GitHub report -->

NextCloudPi diagnostics 

NextCloudPi version  v1.50.2
NextCloudPi image    NextCloudPi_docker_09-29-22
OS                   Debian GNU/Linux 11. 5.15.76-v8+ (aarch64)
automount            no
USB devices          sda 
datadir              /data/nextcloud/data
data in SD           yes
data filesystem      ext2/ext3
data disk usage      27G/118G
rootfs usage         27G/118G
swapfile             /var/swap
dbdir                /data/database
Nextcloud check      ok
Nextcloud version    24.0.5.1
HTTPD service        up
PHP service          up
MariaDB service      up
Redis service        up
HPB service          up
Postfix service      up
Internet check       ok
public IP            ***REMOVED SENSITIVE VALUE***
public IP            ***REMOVED SENSITIVE VALUE***
Port check 80        closed
Port check 443       closed
IP                   ***REMOVED SENSITIVE VALUE***
gateway              ***REMOVED SENSITIVE VALUE***
Interface            eth0
certificates         ***REMOVED SENSITIVE VALUE***
NAT loopback         no
Uptime               43min
Nextcloud configuration 

{
    "system": {
        "passwordsalt": "***REMOVED SENSITIVE VALUE***",
        "secret": "***REMOVED SENSITIVE VALUE***",
        "trusted_domains": {
            "0": "localhost",
            "1": "nextcloudpi",
            "2": "192.168.0.2"
        },
        "datadirectory": "***REMOVED SENSITIVE VALUE***",
        "dbtype": "mysql",
        "version": "24.0.5.1",
        "overwrite.cli.url": "https:\/\/76edc63304ae\/",
        "dbname": "***REMOVED SENSITIVE VALUE***",
        "dbhost": "***REMOVED SENSITIVE VALUE***",
        "dbport": "",
        "dbtableprefix": "oc_",
        "mysql.utf8mb4": true,
        "dbuser": "***REMOVED SENSITIVE VALUE***",
        "dbpassword": "***REMOVED SENSITIVE VALUE***",
        "installed": true,
        "instanceid": "***REMOVED SENSITIVE VALUE***",
        "memcache.local": "\\OC\\Memcache\\Redis",
        "memcache.locking": "\\OC\\Memcache\\Redis",
        "redis": {
            "host": "***REMOVED SENSITIVE VALUE***",
            "port": 0,
            "timeout": 0,
            "password": "***REMOVED SENSITIVE VALUE***"
        },
        "tempdirectory": "\/var\/www\/nextcloud\/data\/tmp",
        "mail_smtpmode": "sendmail",
        "mail_smtpauthtype": "LOGIN",
        "mail_from_address": "***REMOVED SENSITIVE VALUE***",
        "mail_domain": "***REMOVED SENSITIVE VALUE***",
        "preview_max_x": "2048",
        "preview_max_y": "2048",
        "jpeg_quality": "60",
        "overwriteprotocol": "https",
        "trusted_proxies": "***REMOVED SENSITIVE VALUE***",
        "maintenance": false
    }
}
HTTPd logs 

[Tue Nov 08 22:36:40.305591 2022] [ssl:error] [pid 117:tid 548315951120] AH02217: ssl_stapling_init_cert: can't retrieve issuer certificate! [subject: CN=localhost / issuer: CN=localhost / serial: 3592E7EEC24C75A8B68EB52FE39ACFA3329BEEFA / notbefore: Sep 29 10:43:04 2022 GMT / notafter: Sep 26 10:43:04 2032 GMT]
[Tue Nov 08 22:36:40.305643 2022] [ssl:error] [pid 117:tid 548315951120] AH02604: Unable to configure certificate localhost:4443:0 for stapling
[Tue Nov 08 22:36:40.326352 2022] [ssl:error] [pid 118:tid 548315951120] AH02217: ssl_stapling_init_cert: can't retrieve issuer certificate! [subject: CN=localhost / issuer: CN=localhost / serial: 3592E7EEC24C75A8B68EB52FE39ACFA3329BEEFA / notbefore: Sep 29 10:43:04 2022 GMT / notafter: Sep 26 10:43:04 2032 GMT]
[Tue Nov 08 22:36:40.326414 2022] [ssl:error] [pid 118:tid 548315951120] AH02604: Unable to configure certificate localhost:4443:0 for stapling
[Tue Nov 08 22:36:40.331803 2022] [mpm_event:notice] [pid 118:tid 548315951120] AH00489: Apache/2.4.54 (Debian) OpenSSL/1.1.1n configured -- resuming normal operations
[Tue Nov 08 22:36:40.331941 2022] [core:notice] [pid 118:tid 548315951120] AH00094: Command line: '/usr/sbin/apache2'
[Tue Nov 08 23:07:41.807760 2022] [mpm_event:notice] [pid 118:tid 548315951120] AH00492: caught SIGWINCH, shutting down gracefully
[Wed Nov 09 06:12:02.371251 2022] [ssl:error] [pid 120:tid 548222648336] AH02217: ssl_stapling_init_cert: can't retrieve issuer certificate! [subject: CN=localhost / issuer: CN=localhost / serial: 3592E7EEC24C75A8B68EB52FE39ACFA3329BEEFA / notbefore: Sep 29 10:43:04 2022 GMT / notafter: Sep 26 10:43:04 2032 GMT]
[Wed Nov 09 06:12:02.371805 2022] [ssl:error] [pid 120:tid 548222648336] AH02604: Unable to configure certificate localhost:4443:0 for stapling
[Wed Nov 09 06:12:02.396694 2022] [ssl:error] [pid 121:tid 548222648336] AH02217: ssl_stapling_init_cert: can't retrieve issuer certificate! [subject: CN=localhost / issuer: CN=localhost / serial: 3592E7EEC24C75A8B68EB52FE39ACFA3329BEEFA / notbefore: Sep 29 10:43:04 2022 GMT / notafter: Sep 26 10:43:04 2032 GMT]
[Wed Nov 09 06:12:02.396766 2022] [ssl:error] [pid 121:tid 548222648336] AH02604: Unable to configure certificate localhost:4443:0 for stapling
[Wed Nov 09 06:12:02.402110 2022] [mpm_event:notice] [pid 121:tid 548222648336] AH00489: Apache/2.4.54 (Debian) OpenSSL/1.1.1n configured -- resuming normal operations
[Wed Nov 09 06:12:02.402248 2022] [core:notice] [pid 121:tid 548222648336] AH00094: Command line: '/usr/sbin/apache2'
[Wed Nov 09 14:08:46.440886 2022] [ssl:error] [pid 121:tid 547884621840] AH02217: ssl_stapling_init_cert: can't retrieve issuer certificate! [subject: CN=localhost / issuer: CN=localhost / serial: 3592E7EEC24C75A8B68EB52FE39ACFA3329BEEFA / notbefore: Sep 29 10:43:04 2022 GMT / notafter: Sep 26 10:43:04 2032 GMT]
[Wed Nov 09 14:08:46.441461 2022] [ssl:error] [pid 121:tid 547884621840] AH02604: Unable to configure certificate localhost:4443:0 for stapling
[Wed Nov 09 14:08:46.469005 2022] [ssl:error] [pid 122:tid 547884621840] AH02217: ssl_stapling_init_cert: can't retrieve issuer certificate! [subject: CN=localhost / issuer: CN=localhost / serial: 3592E7EEC24C75A8B68EB52FE39ACFA3329BEEFA / notbefore: Sep 29 10:43:04 2022 GMT / notafter: Sep 26 10:43:04 2032 GMT]
[Wed Nov 09 14:08:46.469090 2022] [ssl:error] [pid 122:tid 547884621840] AH02604: Unable to configure certificate localhost:4443:0 for stapling
[Wed Nov 09 14:08:46.471997 2022] [core:warn] [pid 122:tid 547884621840] AH00098: pid file /var/run/apache2/apache2.pid overwritten -- Unclean shutdown of previous Apache run?
[Wed Nov 09 14:08:46.477204 2022] [mpm_event:notice] [pid 122:tid 547884621840] AH00489: Apache/2.4.54 (Debian) OpenSSL/1.1.1n configured -- resuming normal operations
[Wed Nov 09 14:08:46.477347 2022] [core:notice] [pid 122:tid 547884621840] AH00094: Command line: '/usr/sbin/apache2'
Database logs 

tail: cannot open '/var/log/mysql/*.log' for reading: No such file or directory
Nextcloud logs

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by examining the Docker restore flow and the stock container configuration, then reproduce the import with the reported 22 GB .tar backup on a 4 GB system. Use the ncp-report output and container logs to identify where memory consumption grows. Done means the backup restores without exhausting RAM or swap and crashing the server.

Written by the indexing model from the issue text.

Assessment

Tech stack
docker, shell
Domain
devops, infrastructure
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.