deepinsight / deepinsight/insightface

arcface_torch: There are periodic, sudden drops in losses

Open
#2,266 6 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
29.7k
Forks
6.1k
PR merge metrics
No merged PRs in 30d

Description

![image](https://user-images.githubusercontent.com/49122192/226346190-5858b32a-fb08-4b11-8a01-5e3eb5922ac9.png)

backbone: mbf
loss: arcface
dataset: glint (msra + asian celeb)
lr = 0.1 wd = 1e-4 fp16=True

as shown in the figure, there are periodic, sudden drops in losses, I am curious why this happens.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.