deepinsight / deepinsight/insightface

.rec file index error when adding ids to glint360k face2rec2.py error

Open
#1,589 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
29.7k
Forks
6.1k
PR merge metrics
No merged PRs in 30d

Description

When adding data to glint360k, I get wrong index in the new record file.

The new record file's index 0 header is ```HEADER(flag=2, label=array([17186136., 17547740.], dtype=float32), id=0, id2=0)```

When it should be ```HEADER(flag=2, label=array([17186135., 17547740.], dtype=float32), id=0, id2=0)```

I can confirm that the face2rec2.py file runs correctly, but still the above error happens anytime the number of ids in the dataset exceeds 360232. Why does this occur and how can I resolve it? @anxiangsir

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reading face2rec2.py and run it with a dataset exceeding 360232 ids, then inspect the generated .rec file's index-0 HEADER against the reported expected label. Done means the generated header uses 17186135 rather than 17186136 and the conversion remains correct for larger id counts.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
data, machine-learning
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.