google / google/xarray-beam

Missing Chunks after `ChunksToZarr`

Open
#195 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
170
Forks
15
Avg merge
18h 27m
Merged PRs (30d)
1

Description

Firstly, thanks for this library!

The issue I am facing is, for high throughput pipelines in dataflow, I can see that it sometimes misses some chunks randomly.

Is there some way to prevent this? or even atleast validate it?

Image

Image

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.