apache / apache/opendal

new feature: Add CRC32C checksum support for GCS

Open
#5,635 2 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Rust
Stars
5.4k
Forks
825
Avg merge
1d 14m
Merged PRs (30d)
127

Description

### Feature Description

CRC32C is the algorithm recommended in the official documentation of GCS, and because OpenDAL S3 already provides a CRC32C checksum implementation, I think it is intuitive to add CRC32C checksum support to GCS.

### Problem and Solution

GCS Docs: https://cloud.google.com/storage/docs/data-validation.

### Additional Context

_No response_

### Are you willing to contribute to the development of this feature?

- [x] Yes, I am willing to contribute to the development of this feature.

Contributor guide

Open the contributing guide

Research direction

Start with the existing CRC32C checksum implementation in OpenDAL S3 and the linked GCS data-validation documentation. Trace the GCS service implementation to determine where checksum support belongs; done means GCS supports CRC32C validation consistently with the requested behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
cloud
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
38/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.