BinActiveZ:updateGradInput() dependance on input
Aperta
- Lingua principale
- Lua
- Stelle
- 872
- Fork
- 235
- Metriche di merge delle PR
- Nessuna PR unita negli ultimi 30g
Descrizione
I'm not familiar with lua but I'm assuming updateGradInput() is simply zeroing gradOutput wherever input is out of [-1,1] range. Shouldn't it also multiply gradOutput by input values in that range?
I can see that BinActive don't bother computing the K tensor as per the paper. Presumably because they didn't make a massive difference but are you also using a different estimator for derivative of the sign() function for binary activations than the one used for kernels (updateBinaryGradWeight)?
Guida per i contributori
Nessuna guida per i contributori indicizzata per questo repository
Valutazione
Questa issue non è ancora stata valutata.