Kaszanas / Kaszanas/SC2_Datasets

Flexible Validators (applying thresholding)

Open
#20 0 comments 0 reactions 1 assignee Claimed by @Kaszanas View on GitHub
feature request good first issue
Dominant language
Python
Stars
17
Forks
4
PR merge metrics
No merged PRs in 30d

Description

Overall the multiprocessing validator and singleprocess validator could take a ```List[Callable]``` and abstract out the verification process.

Any validation requires a file to be opened. This is strictly a pre-processing step before the files can be used for modeling.
Because of that it is possible to apply threshold values for fields within the open file to classify it as a ```validated_file``` or ```skip_file```

yet it is not yet clear to me how to structure this code.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.