deepinsight / deepinsight/insightface

unable to reproduce the result with lfw at FAR 1e-5

Open
#2,164 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
29.7k
Forks
6.1k
PR merge metrics
No merged PRs in 30d

Description

Hi,

I tried to generate a new large scale lfw benchmark, the protocol is similar to blurf (http://www.cbsr.ia.ac.cn/users/scliao/projects/blufr/)

From the model zoo, I test glint360k_r50 and got 99% accuracy at FAR 1e-5, but I can't reproduce the result from the training code. my result is only 95%

any idea?

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by comparing the model-zoo glint360k_r50 evaluation with the training-code configuration and the BLUFR-like LFW protocol described in the issue. Confirm whether the same data, checkpoint, and FAR 1e-5 measurement produce the reported 99% result; otherwise document the discrepancy and its cause.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
computer-vision, machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.