deepinsight / deepinsight/insightface

oneflow_face train_ofrecord

Open
#1,396 4 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
29.7k
Forks
6.1k
PR merge metrics
No merged PRs in 30d

Description

我下载的faces_emore中的train_ofrecord文件夹下有16个子文件,请问这16个文件是怎么生成的?
991M part-00000
991M part-00001
990M part-00002
991M part-00003
991M part-00004
991M part-00005
991M part-00006
991M part-00007
991M part-00008
991M part-00009
990M part-00010
990M part-00011
991M part-00012
991M part-00013
991M part-00014
991M part-00015

因为我用tools/dataset_convert/mx_recordio_2_ofrecord.py跑glint360k数据,只得到一个130G的part-0,然后我就把config中的train_data_part_num改成1,但是训练的时候会报错如下:
F0127 19:56:54.910080 38389 posix_file_system.cpp:94] Check failed: fd >= 0 Fail to open file train_ofrecord/train/part-00001: No such file or directory [2]
F0127 19:56:54.910089 38390 posix_file_system.cpp:94] Check failed: fd >= 0 Fail to open file train_ofrecord/train/part-00050: No such file or directory [2]F0127 19:56:54.910231 38392 posix_file_system.cpp:94] Check failed: fd >= 0 Fail to open file train_ofrecord/train/part-00150: No such file or directory [2]F0127 19:56:54.910259 38391 posix_file_system.cpp:94] Check failed: fd >= 0 Fail to open file train_ofrecord/train/part-00100: No such file or directory [2]
F0127 19:56:54.910089 38390 posix_file_system.cpp:94] Check failed: fd >= 0 Fail to open file train_ofrecord/train/part-00050: No such file or directory [2]F0127 19:56:54.910231 38392 posix_file_system.cpp:94] Check failed: fd >= 0 Fail to open file train_ofrecord/train/part-00150: No such file or directory [2]F0127 19:56:54.910259 38391 posix_file_system.cpp:94] Check failed: fd >= 0 Fail to open file train_ofrecord/train/part-00100: No such file or directory [2]
F0127 19:56:54.910089 38390 posix_file_system.cpp:94] Check failed: fd >= 0 Fail to open file train_ofrecord/train/part-00050: No such file or directory [2]F0127 19:56:54.910231 38392 posix_file_system.cpp:94] Check failed: fd >= 0 Fail to open file train_ofrecord/train/part-00150: No such file or directory [2]F0127 19:56:54.910259 38391 posix_file_system.cpp:94] Check failed: fd >= 0 Fail to open file train_ofrecord/train/part-00100: No such file or directory [2]
F0127 19:56:54.910089 38390 posix_file_system.cpp:94] Check failed: fd >= 0 Fail to open file train_ofrecord/train/part-00050: No such file or directory [2]F0127 19:56:54.910231 38392 posix_file_system.cpp:94] Check failed: fd >= 0 Fail to open file train_ofrecord/train/part-00150: No such file or directory [2]F0127 19:56:54.910259 38391 posix_file_system.cpp:94] Check failed: fd >= 0 Fail to open file train_ofrecord/train/part-00100: No such file or directory [2]

@nttstar @nlqq

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.