deepchecks / deepchecks/deepchecks
[FEAT] dataset from directory improvments
- Dominant language
- Python
- Stars
- 4.1k
- Forks
- 303
- PR merge metrics
- No merged PRs in 30d
Description
There are a few improvements that can be added that would facilitate the use of this functionality.
No need to do all of them at the same time
1. Add an additional function of image_dataset_from_directory that create vision data with task type "other" that can be really useful for image integrity and train test validation for all tasks. Can work on the following directory structure:
- root/
- train/
image1.jpeg
- test/
image1.jpeg
2. Change the function API to use generic generator instead of torch thereby removing the dependency in torch.
3. Support additional image formats
Contributor guide
Research direction
Start by locating the existing image_dataset_from_directory implementation and its tests. Review the requested directory structure and decide whether to scope work to the "other" task type, replacing the torch-based generator, or adding image formats; done should be defined by the selected improvement and corresponding coverage for that behavior.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, pytorch
- Domain
- data, machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100