awslabs / awslabs/deequ

Add markdown documentation on how to reuse existing results in a MetricsRepository

Open
#37 1 comment 0 reactions 0 assignees View on GitHub
documentation enhancement
Dominant language
Scala
Stars
3.6k
Forks
586
Avg merge
13d 13h
Merged PRs (30d)
1

Description

Show how to use the method reuseExistingResultsForKey and maybe show how this can be used in some example use cases:
* Experiment with checks and constraint suggestion rules
* Run different checks on some data without duplicating work, maybe a cheap one using basic analyzers first and then a second check that uses both the cheap constraints from before and some of the more expensive constraints?

Contributor guide

Open the contributing guide

Research direction

Start by locating the MetricsRepository method reuseExistingResultsForKey and any existing Deequ documentation or examples that use it. Document how to reuse results, including experiments with checks and constraint suggestions and staged checks that avoid duplicate work. Done means the Markdown explains the method and includes the requested use cases.

Written by the indexing model from the issue text.

Assessment

Tech stack
scala, spark
Domain
documentation
Issue type
Documentation
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
55/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.