gaozhihan / gaozhihan/PreDiff

gradient value is very small in energy constraints situation

Open
#15 4 comments 0 reactions 1 assignee Claimed by @gaozhihan View on GitHub
question
Dominant language
Python
Stars
159
Forks
10
PR merge metrics
No merged PRs in 30d

Description

I tried to implement the knowledge network in the energy constraints situation on my own task. However, I found that the `grad` from the `get_mean_shift` function is very small, which will not have any effect on the original mean. For example, the `grad` values are below:

```
tensor([[[[ 2.7554e-08]],

[[-8.8887e-09]],

[[ 8.4224e-09]],

...,

[[ 5.1067e-12]],

[[ 3.8011e-11]],

[[-2.2646e-12]]],

[[[-5.8177e-09]],

[[ 1.4201e-09]],

[[-2.9926e-10]],

...,

[[ 7.6124e-12]],
...
[[-4.7238e-11]],

[[-5.8617e-11]],

[[ 4.8769e-11]]]], device='cuda:0')
```
So what is your case?

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.