albermax / albermax/innvestigate

Question regarding the Implementation of Integrated Gradients and LRP-z

Open
#156 5 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.3k
Forks
230
PR merge metrics
No merged PRs in 30d

Description

Hey Alber,

1. I was reading the Integrated Gradients (IG) paper and my understanding is that they backpropagate through a model **with** softmax layer. I also looked at their code to verify this and the [same was mentioned there](https://github.com/ankurtaly/Integrated-Gradients/blob/master/howto.md#identifying-the-output-tensor) as well.
![image](https://user-images.githubusercontent.com/5251592/61961908-03792a80-af8e-11e9-9585-7fa86d9253f7.png)

But looking at your implementation, my understanding is that you pass a `model_wo_softmax` for analyzing. It would be great if you could help me understand as to why this discrepancy is happening or did I miss something?

2. While looking at the list of methods available in this toolbox, I found that there is another variation of LRP called LRP-z but surprisingly, I could not find it in the papers. In the papers, authors mostly talk about LRP-eps/LRP-alpha-beta. Could you please refer me to the paper where authors discuss LRP-z.

Thanks,
Naman

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.