alibaba / alibaba/x-deeplearning
The implementation of the Attention function is different from the description in DIEN paper.
- Dominant language
- PureBasic
- Stars
- 4.3k
- Forks
- 1k
- PR merge metrics
- No merged PRs in 30d
Description
In `Model_DIEN` the attention weights are calculated by `din_fcn_attention()`, which seems same as `din_attention()` except for:
```
query = tf.layers.dense(query, facts_size, activation=None, name='f1' + stag)
query = prelu(query)
```
And I think this is different from the description in the DIEN paper:

Contributor guide
No contributing guide indexed for this repository
Research direction
Start with Model_DIEN and compare din_fcn_attention() with din_attention(), focusing on the query dense layer and prelu call shown in the issue. Read the DIEN paper's attention description and determine whether the implementation should match it; done means the behavior and corresponding validation reflect the paper or the discrepancy is documented.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- tensorflow
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 25/100