n0-computer / n0-computer/sendme
feat: compress entire blobs protocol using zstd or lz4
Nobody has claimed this yet.
- Dominant language
- Rust
- Stars
- 1.2k
- Forks
- 78
- PR merge metrics
- No merged PRs in 30d
Description
Per-file compression was implemented in https://github.com/n0-computer/sendme/pull/93 , but per-file compression has various downsides.
- it requires to copy the files, so the sendme send temp dir might become huge
- compression of multiple small files won't be very efficient
A better approach would be to optionally compress the entire protocol under a different ALPN, using zstd or maybe lz4 since lz4 has a pure rust impl.
This is not yet possible in blobs, but will be possible once https://github.com/n0-computer/iroh-blobs/pull/147 is merged.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reading the per-file compression implementation in pull request #93 and the dependency work in iroh-blobs pull request #147. Confirm when blob-level compression is available, then define how optional whole-protocol compression and its separate ALPN should work. Done means the protocol can compress entire transfers without copying individual files, using zstd or lz4.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- rust
- Domain
- cli, networking
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100