bazelbuild / bazelbuild/remote-apis
V3 idea: No longer allow Digest.size_bytes <= 0
- Dominant language
- Go
- Stars
- 445
- Forks
- 141
- PR merge metrics
- No merged PRs in 30d
Description
Right now it is allowed to create Digest messages that have `size_bytes == 0`, referring to the empty blob. In #131 we're extending the protocol to require that the empty blob is always present, because it can be derived trivially. I personally find this a bit problematic:
- It makes the protocol less regular and consistent.
- Naïvely implemented client/servers will get this wrong. For example, what is FindMissingBlobs() on `{hash: "e984d2bdd07318c4e29f7a2ceea4a9e4569e2d8e695a953a4e2df6f69fbdec95", size_bytes: 0}` supposed to do? Report existence, because it has size zero? Or should it report absence, because the empty blob actually has SHA-256 sum `e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855`?
- When digests for empty blobs are embedded in other messages, they still waste space. We still end up storing a SHA-256 sum.
I would like to suggest that we simply deny the existence of Digest messages with `size_bytes <= 0`. Any field where the empty blob needs to be referenced, we should use null. This means that the optimization that Bazel performs of not loading the empty blob becomes the norm, as there is no longer any way to even address the empty blob.
Contributor guide
Research direction
No files, tests, or entry points are named. Start by reviewing the Digest definition and the protocol extension discussed in #131; done means Digest messages with size_bytes <= 0 are disallowed and empty-blob references use null consistently.
Written by the indexing model from the issue text.
Assessment
- Domain
- api, backend-api-design
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 25/100