developmentseed / developmentseed/virtualizarr-data-pipelines

Add validation framework for pipelines

Open
#11 0 comments 0 reactions 1 assignee Claimed by @tylanderson View on GitHub
Dominant language
Python
Stars
8
Forks
1
Avg merge
1d 6h
Merged PRs (30d)
4

Description

Adding a framework to allow users to add validation (e.g. using [pandera](https://pandera.readthedocs.io/en/stable/index.html)) would allow a level of safety for ongoing updates to datasets. See ingestion lessons learned at https://www.earthmover.io/blog/virtual-zarr

Probably should be optional but highly recommended.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.