akanimax / akanimax/BMSG-GAN

Why smaller batch size results better results? With the epochs increased, the G loss went up?

Open
#39 1 comment 1 reaction 0 assignees View on GitHub
Dominant language
Python
Stars
625
Forks
103
PR merge metrics
No merged PRs in 30d

Description

There are 8k+ 256*256 images in my datasets, I set batchsize=32 and trained with 4 12GB GPUs, but it's not as good as I set batchsize = 4 and trained with one GPU,neither the training speed nor the image quality. Why a smaller batch size results better results? Is there a best batchsize?
Beside,I set batchsize=4, when epoch>70, g-loss went up obviously,and qualities of generated images went worse.Why did this happen? (Training process was interrupted when epoch = 54, I reloaded weight files and optimer states from epoch 53 )
Thanks!

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.