AI4Finance-Foundation / AI4Finance-Foundation/ElegantRL

Might be a bug in `AgentPPO`

Abierto
#451 0 comentarios 0 reacciones 0 asignados Ver en GitHub
Lenguaje dominante
Python
Estrellas
4.4k
Forks
978
Métricas de merge de PR
Sin PR fusionados en 30 d

Descripción

In `AgnetPPO`, `act_target` and `cri_target` may not be properly initialized and are only set to `None` in the parent class, which could lead to errors when calling `save_or_load()`.

The same issue may also occur in agents such as `AgentDiscretePPO`, `AgentDiscreteA2C`, and other similar agents.

I encountered this problem while training with `AgentPPO` in a custom environment. It was resolved by initializing `act_target` and `cri_target` with `self.act` and `self.cri` , respectively, during the initialization of AgentPPO.

Guía de contribución

No hay ninguna guía de contribución indexada para este repositorio

Evaluación

Este issue todavía no se ha evaluado.

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.