google / google/xarray-beam

Use xbeam to append?

Open
#121 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
170
Forks
15
Avg merge
18h 27m
Merged PRs (30d)
1

Description

I have some `xbeam` pipelines that write Zarr2. I'd like to append. It's easy enough to do `new_data.to_zarr(path, mode='-a', consolidated=True)` to append a small amount of data...but I wonder if there's a way to use `xbeam` to append a much larger set.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.