[Long Term Strategy and Priorities] Migration of S3 Bucket Payments to Foundation
Nobody has claimed this yet.
- Dominant language
- No language data
- Stars
- 141
- Forks
- 17
- PR merge metrics
- No merged PRs in 30d
Description
Listing out all options/possibilities that have been brought up or being explored for the long term improvements/resolutions/options below. Please add in anything that might be of interest to bring up/discuss/alternative options on the topic.
Discussion: https://discourse.nixos.org/t/the-nixos-foundations-call-to-action-s3-costs-require-community-support/28672
Thank you to joepie91 and raitobezarius for helping put this initial list together from the matrix/discourse discussions:
- Tahoe-LAFS (distributed storage, not S3-compatible out of the box, can support storage nodes of any size and complexity including low-trust, but is slow) + central gateway server(s) to bridge to Fastly
- Tahoe-LAFS but with narinfo stored directly on the central gateway server(s) for better performance
- Garage (distributed storage, S3-compatible, flexible in storage node size, but nodes must be reliable and trustworthy, and cluster configuration must stay reasonably stable)
- Minio (distributed storage-ish, S3 compatible, fairly rigid expectations in cluster layout, commercial so future FOSS status is questionable)
- Single Big Server (optionally with replica) serving up the entire cache ... as owned hardware, colocated at a datacenter, with or without outsourced hardware management ... as a rented dedicated server(s), so hardware issues will be taken care of by the datacenter ... supplied by one or more sponsors
- Running university/ISP mirror schemes like many other distros do (eg. MirrorBrain)
- Hosting (historical) content at an academic/research institution
- Deleting old items from the cache (irrecoverable)
- Deleting items from staging once no longer needed
- Aggressively deduplicating and/or compressing our storage
- Ceph (distributed filesystem for petabyte scale, S3 compatible, industry standard, non-trivial to operate)
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reading issue #86 and the linked Discourse discussion about NixOS Foundation S3 costs. Review the listed storage and hosting options, their trade-offs, and any later discussion. The work is complete only when the long-term priorities and next steps are documented, but this issue does not define who decides or the expected output.
Written by the indexing model from the issue text.
Assessment
- Domain
- cloud, infrastructure
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100