AI4Finance-Foundation / AI4Finance-Foundation/ElegantRL

Might be a bug in `AgentPPO`

Ouverte
#451 0 commentaires 0 réactions 0 personnes assignées Voir sur GitHub
Langage dominant
Python
Étoiles
4.4k
Forks
978
Métriques de merge des PR
Aucune PR mergée en 30 j

Description

In `AgnetPPO`, `act_target` and `cri_target` may not be properly initialized and are only set to `None` in the parent class, which could lead to errors when calling `save_or_load()`.

The same issue may also occur in agents such as `AgentDiscretePPO`, `AgentDiscreteA2C`, and other similar agents.

I encountered this problem while training with `AgentPPO` in a custom environment. It was resolved by initializing `act_target` and `cri_target` with `self.act` and `self.cri` , respectively, during the initialization of AgentPPO.

Guide de contribution

Aucun guide de contribution indexé pour ce dépôt

Piste de recherche

Locate AgentPPO, AgentDiscretePPO, and AgentDiscreteA2C, then trace their save_or_load() paths into the parent class. Compare how act_target and cri_target are initialized across these agents, and verify that saving and loading completes without errors for the affected agents.

Rédigé par le modèle d'indexation à partir du texte de l'issue.

Évaluation

Stack technique
python, pytorch
Domaine
machine-learning
Type d'issue
Bug
Difficulté
3/5
Temps estimé
1-2 jours
Activité
À l'abandon
Clarté
Plutôt claire
Accessibilité débutants
35/100

Recevez les nouvelles issues par e-mail

Un résumé court des issues GitHub adaptées aux débutants.