owncloud / owncloud/ocis

Allow to store all data on s3 (blob and metadata)

Open
#4,594 4 comments 0 reactions 0 assignees View on GitHub
Category:Enhancement Status:Proposal
Dominant language
Go
Stars
2.1k
Forks
274
Avg merge
2d 1h
Merged PRs (30d)
103

Description

## Is your feature request related to a problem? Please describe.
Currently only the blobs are stored on s3 with s3ng, the metadata are kept on the local pv. This makes a scaled and distributed installation unnecessary hard because there is a separate distributed / replicated storage needed. Modern s3 stacks like minio replicate the data on their own, so there is normally no need for a complicated distributed storage like ceph, longhorn, glusterfs or others.

## Describe the solution you'd like
When specifying the s3 storage driver I would expect that all data (Blobs and Metadata) are stored on s3, so that a additional pv is not needed anymore.

## Describe alternatives you've considered
Well, not really one, because the need to have a distributed filesystem does not really exist anymore in our environment. Blob storages replicates themself and databases also. The configs normally reside in configmaps and therefore are replicated by k8s.

## Additional context
I would expect that this should be possible, because high data apps like Grafana Loki (Logs) or Grafana Mimir (Metrics) are already able to handle this.
I know that the old s3 driver stored all data on s3, but not in an efficient way. But I think there should be a solution, because this would really help to reduce the administrative efforts (backup, deployment, ...)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.