cleanlab / cleanlab/cleanvision
Handle PIL UnidentifiedImageError exception when running cleanvision on local image folder dataset
- Dominant language
- Python
- Stars
- 1.2k
- Forks
- 83
- PR merge metrics
- No merged PRs in 30d
Description
# Stack trace
```
Traceback (most recent call last):
File "/home/sanjana/code/sandbox/zero_shot_image_issues/nsfw_cleanvision.py", line 5, in
lab.find_issues(issue_types={"odd_size":{}})
File "/home/sanjana/code/sandbox/.venv/lib/python3.10/site-packages/cleanvision/imagelab.py", line 273, in find_issues
issue_manager.find_issues(
File "/home/sanjana/code/sandbox/.venv/lib/python3.10/site-packages/cleanvision/issue_managers/image_property_issue_manager.py", line 162, in find_issues
results = list(
File "/home/sanjana/code/sandbox/.venv/lib/python3.10/site-packages/tqdm/std.py", line 1178, in __iter__
for obj in iterable:
File "/usr/lib/python3.10/multiprocessing/pool.py", line 448, in
return (item for chunk in result for item in chunk)
File "/usr/lib/python3.10/multiprocessing/pool.py", line 870, in next
raise value
PIL.UnidentifiedImageError: cannot identify image file
```
# Steps to reproduce
Use a local image dataset with one buggy file which cannot be loaded using `Image.open(path)`
# Intended workflow
The code should skip files throwing an error while calling Image.open() and continue processing the rest of the dataset. However, the erroneous files should be reported in the logs.
Contributor guide
Assessment
This issue has not been assessed yet.