NixOS / NixOS/foundation

[Long Term Strategy and Priorities] Migration of S3 Bucket Payments to Foundation

Open
#86 26 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
No language data
Stars
141
Forks
17
PR merge metrics
No merged PRs in 30d

Description

Listing out all options/possibilities that have been brought up or being explored for the long term improvements/resolutions/options below. Please add in anything that might be of interest to bring up/discuss/alternative options on the topic.
Discussion: https://discourse.nixos.org/t/the-nixos-foundations-call-to-action-s3-costs-require-community-support/28672
Thank you to joepie91 and raitobezarius for helping put this initial list together from the matrix/discourse discussions:

  1. Tahoe-LAFS (distributed storage, not S3-compatible out of the box, can support storage nodes of any size and complexity including low-trust, but is slow) + central gateway server(s) to bridge to Fastly
  2. Tahoe-LAFS but with narinfo stored directly on the central gateway server(s) for better performance
  3. Garage (distributed storage, S3-compatible, flexible in storage node size, but nodes must be reliable and trustworthy, and cluster configuration must stay reasonably stable)
  4. Minio (distributed storage-ish, S3 compatible, fairly rigid expectations in cluster layout, commercial so future FOSS status is questionable)
  5. Single Big Server (optionally with replica) serving up the entire cache ... as owned hardware, colocated at a datacenter, with or without outsourced hardware management ... as a rented dedicated server(s), so hardware issues will be taken care of by the datacenter ... supplied by one or more sponsors
  6. Running university/ISP mirror schemes like many other distros do (eg. MirrorBrain)
  7. Hosting (historical) content at an academic/research institution
  8. Deleting old items from the cache (irrecoverable)
  9. Deleting items from staging once no longer needed
  10. Aggressively deduplicating and/or compressing our storage
  11. Ceph (distributed filesystem for petabyte scale, S3 compatible, industry standard, non-trivial to operate)

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reading issue #86 and the linked Discourse discussion about NixOS Foundation S3 costs. Review the listed storage and hosting options, their trade-offs, and any later discussion. The work is complete only when the long-term priorities and next steps are documented, but this issue does not define who decides or the expected output.

Written by the indexing model from the issue text.

Assessment

Domain
cloud, infrastructure
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.