deepinsight / deepinsight/insightface

Training speed was not accelerated with DALI

Open
#2,025 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
29.7k
Forks
6.1k
PR merge metrics
No merged PRs in 30d

Description

Training: 412-Speed 556.82 samples/sec Loss 42.4856 LearningRate 0.001128 Epoch: 0 Global Step: 600 Fp16 Grad Scale: 256 Required: 426 hours

>>> 2 gpu, bs=320, wf42m
>>>num_workers=16, sample_rate=0.2
>>>dali_data_iter(..., num_threads=16, ...)
>>>cuda 10.1 -->install nvidia-dali-cuda102 / nvidia-dali-cuda100
why?

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.