carpedm20 / carpedm20/DCGAN-tensorflow

Batch normalization shared between real and fake examples?

Open
#266 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
JavaScript
Stars
7.2k
Forks
2.6k
PR merge metrics
No merged PRs in 30d

Description

Hi,
It seems that in model.py when discriminator() is called twice, variables of the batch norm layers are also shared between the real and fake example batches. Is this design intentional? But in https://github.com/soumith/ganhacks it suggests that batch norm be separate for the two kinds of examples. Which design is more reasonable?
Thank you!!

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reading model.py and tracing the two discriminator() calls for the real and fake example batches, focusing on how TensorFlow batch-normalization variables are scoped and reused. Compare that behavior with the separate-batch guidance in the linked ganhacks resource. Done requires a decided, documented design and corresponding implementation change, if needed.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, tensorflow
Domain
machine-learning
Issue type
Refactor
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
15/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.