AI4Finance-Foundation / AI4Finance-Foundation/ElegantRL
Might be a bug in `AgentPPO`
- Langage dominant
- Python
- Étoiles
- 4.4k
- Forks
- 978
- Métriques de merge des PR
- Aucune PR mergée en 30 j
Description
In `AgnetPPO`, `act_target` and `cri_target` may not be properly initialized and are only set to `None` in the parent class, which could lead to errors when calling `save_or_load()`.
The same issue may also occur in agents such as `AgentDiscretePPO`, `AgentDiscreteA2C`, and other similar agents.
I encountered this problem while training with `AgentPPO` in a custom environment. It was resolved by initializing `act_target` and `cri_target` with `self.act` and `self.cri` , respectively, during the initialization of AgentPPO.
Guide de contribution
Aucun guide de contribution indexé pour ce dépôt
Piste de recherche
Locate AgentPPO, AgentDiscretePPO, and AgentDiscreteA2C, then trace their save_or_load() paths into the parent class. Compare how act_target and cri_target are initialized across these agents, and verify that saving and loading completes without errors for the affected agents.
Rédigé par le modèle d'indexation à partir du texte de l'issue.
Évaluation
- Stack technique
- python, pytorch
- Domaine
- machine-learning
- Type d'issue
- Bug
- Difficulté
- 3/5
- Temps estimé
- 1-2 jours
- Activité
- À l'abandon
- Clarté
- Plutôt claire
- Accessibilité débutants
- 35/100