nextcloud / nextcloud/server

[Bug]: High UI latency and COPY failures with object storage + encryption

Open
#41,794 12 comments 0 reactions 1 assignee View on GitHub

Nobody has claimed this yet.

0. Needs triage 26-feedback bug feature: encryption (server-side) feature: object storage performance 🚀
Dominant language
PHP
Stars
36.9k
Forks
5.2k
Avg merge
2d 3h
Merged PRs (30d)
713

Description

⚠️ This issue respects the following points: ⚠️
Bug description

Copying folders with files and subfolders when object storage as primary storage is configured is unreliable and very slow.

Installation details:

helm chart nextcloud-3.5.21
image: tag: 26.0.5-apache
db: mariadb
redis: enabled

Object Storage as primary storage: MinIO
Configured according to the following documentation: https://docs.nextcloud.com/server/13/admin_manual/configuration_files/primary_storage.html#simple-storage-service-s3

Steps to reproduce
  1. Create a folder with a subfolder. The folder should be around 600 MB. Create 10 files in the folder, 10 files in the subfolder. Some of the files should be around 100 MB, others only 2 MB
  2. Copy the folder via API (https://docs.nextcloud.com/server/19/developer_manual/client_apis/WebDAV/basic.html#copying-files-and-folders-rfc4918) or via Nextcloud UI.
  • Depending on the overwrite flag the following responses are returned:
    • overwrite true: 423 Locked, Exception: OCA\DAV\Connector\Sabre\Exception\FileLocked, message: "xxx" is locked, existing lock on file: exclusive
    • overwrite false: 412 Precondition Failed, Exception: Sabre\DAV\Exception\PreconditionFailed, message: The destination node already exists, and the overwrite header is set to false
  • In > 90% of the requests the folder is not copied completely. Some files are not copied at all, others have the ending .part and are incomplete.
  • The requests take > 60s
Expected behavior

The COPY command should function reliable. What also is remarkable is the overall latency of the UI and the COPY command. The UI is nearly unusable due to latency issues (showing folders and files in the overview, copying them, ...). For example the COPY command takes > 60s. On a similar installation without object storage as primary storage the requests take < 5s and work reliable. Also the overall latency of the UI is much better.

Installation method

None

Nextcloud Server version

26

Operating system

None

PHP engine version

None

Web server

None

Database engine version

None

Is this bug present after an update or on a fresh install?

None

Are you using the Nextcloud Server Encryption module?

None

What user-backends are you using?
  • Default user-backend (database)
  • LDAP/ Active Directory
  • SSO - SAML
  • Other
Configuration report

No response

List of activated Apps

No response

Nextcloud Signing status

No response

Nextcloud Logs

No response

Additional info

No response

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.