facebook / facebook/zstd

Question about seekable format and checksums

Open
#4,374 0 comments 3 reactions 0 assignees View on GitHub
Dominant language
C
Stars
27.9k
Forks
2.6k
Avg merge
1d 3h
Merged PRs (30d)
8

Description

The seek table of the seekable format has an optional `Checksum` [field](https://github.com/facebook/zstd/blob/dev/contrib/seekable_format/zstd_seekable_compression_format.md#seek_table_entries) for every frame, where the least 32 bit of the xxh64 hash of the uncompressed frame data are stored. However, the `Content_Checksum` field of a [zstd frame](https://github.com/facebook/zstd/blob/dev/doc/zstd_compression_format.md#zstandard-frames) seems to have the same purpose. I there a reason for the seekable format not to use the `Content_Checksum` field with `ZSTD_c_checksumFlag`?

Also, how should I understand the contrib directory, especially the seekable format? Should I take it more as a proof of concept of seekable compression with zstd or more like a feature? I'm just asking out of curiosity.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.