cleanlab / cleanlab/cleanvision

Handle PIL UnidentifiedImageError exception when running cleanvision on local image folder dataset

Open
#222 0 comments 0 reactions 0 assignees View on GitHub
bug help wanted
Dominant language
Python
Stars
1.2k
Forks
83
PR merge metrics
No merged PRs in 30d

Description

# Stack trace

```
Traceback (most recent call last):
File "/home/sanjana/code/sandbox/zero_shot_image_issues/nsfw_cleanvision.py", line 5, in
lab.find_issues(issue_types={"odd_size":{}})
File "/home/sanjana/code/sandbox/.venv/lib/python3.10/site-packages/cleanvision/imagelab.py", line 273, in find_issues
issue_manager.find_issues(
File "/home/sanjana/code/sandbox/.venv/lib/python3.10/site-packages/cleanvision/issue_managers/image_property_issue_manager.py", line 162, in find_issues
results = list(
File "/home/sanjana/code/sandbox/.venv/lib/python3.10/site-packages/tqdm/std.py", line 1178, in __iter__
for obj in iterable:
File "/usr/lib/python3.10/multiprocessing/pool.py", line 448, in
return (item for chunk in result for item in chunk)
File "/usr/lib/python3.10/multiprocessing/pool.py", line 870, in next
raise value
PIL.UnidentifiedImageError: cannot identify image file
```
# Steps to reproduce

Use a local image dataset with one buggy file which cannot be loaded using `Image.open(path)`

# Intended workflow
The code should skip files throwing an error while calling Image.open() and continue processing the rest of the dataset. However, the erroneous files should be reported in the logs.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.