MaartenGr / MaartenGr/PolyFuzz

Weirdly High scores (False Positives)

Open
#41 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
803
Forks
72
PR merge metrics
No merged PRs in 30d

Description

I have been experimenting with PolyFuzz for a while. I have observed some weird scoring behavouir. Following is the case in which I am getting a very high score of 90 despite the string hardly equal. It is not expected to get such high scores just because of common string "america", the edit distance would be very low if you compare it with list1 strings.

```
list1= ["american Futures and Options Exchange","America First Credit Union"]
list2=["america"]
model = PolyFuzz("EditDistance").match(list1, list2)
data=model.get_matches()
print(data)
```

```
From To Similarity
0 american Futures and Options Exchange america 0.9
1 America First Credit Union america 0.9
```

Any workaround would be appreciated... Thanks!

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by running the issue's PolyFuzz("EditDistance") example and inspect the EditDistance matching entry point and its score calculation. Compare the result with the expected edit-distance behavior described in the report; done means the example no longer produces the reported 0.9 false positives or the intended workaround is documented.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
backend
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
38/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.