Blosc / Blosc/c-blosc2

Add checksums to chunks

Open
#69 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
C
Stars
584
Forks
112
PR merge metrics
No merged PRs in 30d

Description

For safety and for early discovery of data corruption, one might be interesting to add (optional) checksums for chunks (and maybe for frames too).

Libraries like [xxHash](https://github.com/Cyan4973/xxHash) or an [SSSE3 version of adler32](https://github.com/zlib-ng/zlib-ng/pull/298) might be good fits for this.

Contributor guide

Open the contributing guide

Research direction

The issue does not name files, tests, or entry points. Start by locating the chunk serialization and frame handling code, then review the on-disk format and existing corruption checks. Done would require an agreed optional checksum design, implementation, and coverage for corrupted chunks or frames.

Written by the indexing model from the issue text.

Assessment

Tech stack
c
Domain
databases
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.