clab / clab/dynet

Masking input timesteps for LSTMBuilder.add_inputs?

Open
#844 7 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
C++
Stars
3.4k
Forks
701
PR merge metrics
No merged PRs in 30d

Description

Hi all,

I am currently manually minibatching my code for a seq2seq model. I am using masking to batch together my examples. I understand that for the output, I can multiply each output token's loss by the mask value, and have a masked output.

How do I mask the input? I think that set_dropout_masks seems to be the solution to my problem, but I'm not sure how to use it. Any help would be greatly appreciated! Thanks!

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.