allenai / allenai/ScienceWorld
It seems wait is enough to let the model complete the task
Abierto
- Lenguaje dominante
- Scala
- Estrellas
- 391
- Forks
- 42
- Métricas de merge de PR
- Sin PR fusionados en 30 d
Descripción
I recently ran several RL experiments using this environment, but I found that my policy model tends to output the wait action repeatedly. In the current setup, a single wait action advances the environment by 10 iterations/steps, and if the agent performs more than 10 consecutive waits, the environment automatically considers the task completed.
I’m trying to understand how to address this issue. How can I prevent the model from overusing the wait action or adjust the environment so this doesn’t prematurely end the task?
Guía de contribución
No hay ninguna guía de contribución indexada para este repositorio
Evaluación
Este issue todavía no se ha evaluado.