localminimum / localminimum/QANet
why did u add this kind of dropout in every residual block
Open
- Dominant language
- Python
- Stars
- 985
- Forks
- 297
- PR merge metrics
- No merged PRs in 30d
Description
`def layer_dropout(inputs, residual, dropout):
pred = tf.random_uniform([]) < dropout
return tf.cond(pred, lambda: residual, lambda: tf.nn.dropout(inputs, 1.0 - dropout) + residual)`
Contributor guide
No contributing guide indexed for this repository
Research direction
Start at the layer_dropout entry point shown in the issue and trace where it is used in the residual blocks. Review the repository history and surrounding TensorFlow behavior to determine the rationale for the conditional dropout; done means documenting a supported explanation for this design.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, tensorflow
- Domain
- machine-learning
- Issue type
- Documentation
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100