Kaszanas / Kaszanas/SC2_Datasets
Flexible Validators (applying thresholding)
Open
feature request
good first issue
- Dominant language
- Python
- Stars
- 17
- Forks
- 4
- PR merge metrics
- No merged PRs in 30d
Description
Overall the multiprocessing validator and singleprocess validator could take a ```List[Callable]``` and abstract out the verification process.
Any validation requires a file to be opened. This is strictly a pre-processing step before the files can be used for modeling.
Because of that it is possible to apply threshold values for fields within the open file to classify it as a ```validated_file``` or ```skip_file```
yet it is not yet clear to me how to structure this code.
Contributor guide
Assessment
This issue has not been assessed yet.