AI4Finance-Foundation / AI4Finance-Foundation/FinRL

All episodes SAME REWARD!

未關閉
#713 2 則留言 0 個 reaction 已指派 0 人 在 GitHub 檢視
bug
主要語言
Jupyter Notebook
星號
16.3k
分支
3.5k
PR 合併指標
30 天內沒有已合併 PR

描述

Dears,
Thank you for framework, Please see the output of hyperparameter training on SB3 algorithm, why the reward in all episodes doesn`t change, what`s the problem?(I copied only three outputs)The reward output is the same in every study for any hyperparameter configuration

---------------------------------
| time/ | |
| episodes | 172 |
| fps | 92 |
| time_elapsed | 1014 |
| total_timesteps | 93568 |
| train/ | |
| actor_loss | 5.13 |
| critic_loss | 7.43 |
| ent_coef | 0.00201 |
| learning_rate | 0.0148 |
| n_updates | 93447 |
| reward | **-3.8389** |
---------------------------------

---------------------------------
| time/ | |
| episodes | 176 |
| fps | 92 |
| time_elapsed | 1039 |
| total_timesteps | 95744 |
| train/ | |
| actor_loss | 4.84 |
| critic_loss | 39.8 |
| ent_coef | 0.00201 |
| learning_rate | 0.0148 |
| n_updates | 95623 |
| reward | **-3.8389** |
---------------------------------

---------------------------------
| time/ | |
| episodes | 180 |
| fps | 92 |
| time_elapsed | 1062 |
| total_timesteps | 97920 |
| train/ | |
| actor_loss | 4.44 |
| critic_loss | 3.66 |
| ent_coef | 0.00201 |
| learning_rate | 0.0148 |
| n_updates | 97799 |
| reward | **-3.8389** |
---------------------------------

貢獻指南

這個儲存庫沒有索引到貢獻指南

評估

這個 Issue 還沒有評估資料。

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。