allenai / allenai/bilm-tf

Have a problem with training

Open
#91 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.6k
Forks
447
PR merge metrics
No merged PRs in 30d

Description

![image](https://user-images.githubusercontent.com/33111340/44965530-ab49cc00-af68-11e8-989f-fd3dc7ff564e.png)
Hyperparameters were set as below:
'n_epoch=10
batch_size=128
n_gpu=2
'
Now there are 1016060 sentences loaded, and been trained 189300 batch, but it doesn't match ,189300*128>1016060*10 ,can anyone tell me what cause this?

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.