deepinsight / deepinsight/insightface

Issues with reproducing some accuracies illustrated in insightface/model_zoo github

Open
#2,535 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
29.7k
Forks
6.1k
PR merge metrics
No merged PRs in 30d

Description

Hello,

We have issues with reproducing accuracies illustrated in insightface/model_zoo github through the following table :

IResnetList

We downloaded the associated .onnx files from the link in the last column of the table. We used a python script and loaded the .onnx files using the "load" method of onnx package. We also used "get_model" method of "insightface.model_zoo" package. In both cases, we found different results from the table. In both cases, we obtained different results from the table for LFW dataset (80.4% vs 99.55% for VGG2).

Do we need to preprocess the .onnx file in order to get the accuracy you show in the table?

Best regards,

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reproducing the reported LFW result with the downloaded .onnx files, comparing the Python script's onnx loading path with insightface.model_zoo.get_model. Check the table's VGG2 entry and the stated preprocessing assumptions; done means the accuracy discrepancy and required preprocessing are documented or the affected model information is corrected.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
computer-vision, machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.