deepinsight / deepinsight/insightface

About the performance of MobileFaceNet on IJB dataset

Open
#2,214 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
29.7k
Forks
6.1k
PR merge metrics
No merged PRs in 30d

Description

Recently, I have used ijb_evals.py to test mobilefacenet based on arcface. The train dataset is CASIA-WebFace and the performance is as follows,and I wonder if the results are reasonable because N1D1F0 TAR@FAR=0.01% is only 0.3. Is the truth similar to my result?

| | 1e-06 | 1e-05 | 0.0001 | 0.001 | 0.01 | 0.1 | AUC |
|:-----------------------------------------|-----------:|----------:|---------:|---------:|---------:|---------:|---------:|
| mobilefacenet_arcface_IJBB_11_N1D1F1 | 0.0109056 | 0.0493671 | 0.303213 | 0.72853 | 0.904576 | 0.975365 | 0.989172 |
| mobilefacenet_arcface_IJBB_11_N1D1F0 | 0.0113924 | 0.0507303 | 0.3 | 0.718111 | 0.901071 | 0.973905 | 0.988566 |
| mobilefacenet_arcface_IJBB_11_N1D0F1 | 0.00769231 | 0.0395326 | 0.237293 | 0.6852 | 0.896203 | 0.974586 | 0.988449 |
| mobilefacenet_arcface_IJBB_11_N1D0F0 | 0.00788705 | 0.040409 | 0.229503 | 0.674002 | 0.891237 | 0.972152 | 0.987863 |
| mobilefacenet_arcface_IJBB_11_N0D1F1 | 0.011295 | 0.0539435 | 0.240117 | 0.696981 | 0.900682 | 0.97371 | 0.988731 |
| mobilefacenet_arcface_IJBB_11_N0D1F0 | 0.0130477 | 0.0487829 | 0.237001 | 0.681305 | 0.897468 | 0.972541 | 0.988158 |
| mobilefacenet_arcface_IJBB_11_N0D0F1 | 0.00895813 | 0.0380721 | 0.184907 | 0.641285 | 0.891431 | 0.971081 | 0.98786 |
| mobilefacenet_arcface_IJBB_11_N0D0F0 | 0.0111003 | 0.0370983 | 0.182376 | 0.62259 | 0.886855 | 0.97001 | 0.987306 |

| | 1e-06 | 1e-05 | 0.0001 | 0.001 | 0.01 | 0.1 | AUC |
|:-----------------------------------------|----------:|----------:|---------:|---------:|---------:|---------:|---------:|
| mobilefacenet_arcface_IJBC_11_N1D1F1 | 0.0172317 | 0.0596206 | 0.315795 | 0.73544 | 0.914557 | 0.978013 | 0.989999 |
| mobilefacenet_arcface_IJBC_11_N1D1F0 | 0.0170783 | 0.0696426 | 0.322953 | 0.729918 | 0.909802 | 0.975661 | 0.989554 |
| mobilefacenet_arcface_IJBC_11_N1D0F1 | 0.0143171 | 0.0478601 | 0.255203 | 0.697909 | 0.905763 | 0.976632 | 0.989416 |
| mobilefacenet_arcface_IJBC_11_N1D0F0 | 0.0141637 | 0.0542517 | 0.263793 | 0.692591 | 0.902132 | 0.97428 | 0.988943 |
| mobilefacenet_arcface_IJBC_11_N0D1F1 | 0.0193793 | 0.0634044 | 0.259754 | 0.69208 | 0.910927 | 0.976172 | 0.989532 |
| mobilefacenet_arcface_IJBC_11_N0D1F0 | 0.0183566 | 0.0713811 | 0.263384 | 0.682773 | 0.907194 | 0.974843 | 0.989108 |
| mobilefacenet_arcface_IJBC_11_N0D0F1 | 0.0125275 | 0.0494963 | 0.210359 | 0.636703 | 0.901621 | 0.974792 | 0.98885 |
| mobilefacenet_arcface_IJBC_11_N0D0F0 | 0.0133456 | 0.0496497 | 0.21849 | 0.631181 | 0.897633 | 0.973053 | 0.988405 |

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.