dsc-iem / dsc-iem/WolfMaths

Adjusting the dataset

Open
#4 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
11
Forks
4
PR merge metrics
No merged PRs in 30d

Description

Hello!
I am really happy with the project that you have put forward. However, there is a problem that I could use your help in fixing with the dataset.
The dataset includes many letters/numbers that are similar to one another. What I mean is, a handwritten be is often mis-interpreted as a 6 - even by humans. There are many such letters, which I would like to take out of the dataset. I kindof did this by doing !rm -rf {directory} on the images that I didn't want to include, however the model still predicts them nonetheless. How can I circumvent this?

Edit: I'm sure it has something to do with editing the CSV, and I'm currently trying to figure this stuff out via your dataprocessing.ipynb file, but i'm struggling

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with dataprocessing.ipynb and inspect how the CSV maps image directories to labels, then compare those entries with the deleted images. Trace how the resulting dataset is used for model prediction; done means the excluded letter/number classes are no longer represented in the processed dataset or predictions.

Written by the indexing model from the issue text.

Assessment

Tech stack
jupyter-notebook, python
Domain
computer-vision, machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.