allenai / allenai/ScienceWorld

It seems wait is enough to let the model complete the task

Abierto
#79 1 comentario 0 reacciones 0 asignados Ver en GitHub
Lenguaje dominante
Scala
Estrellas
391
Forks
42
Métricas de merge de PR
Sin PR fusionados en 30 d

Descripción

I recently ran several RL experiments using this environment, but I found that my policy model tends to output the wait action repeatedly. In the current setup, a single wait action advances the environment by 10 iterations/steps, and if the agent performs more than 10 consecutive waits, the environment automatically considers the task completed.

I’m trying to understand how to address this issue. How can I prevent the model from overusing the wait action or adjust the environment so this doesn’t prematurely end the task?

Guía de contribución

No hay ninguna guía de contribución indexada para este repositorio

Evaluación

Este issue todavía no se ha evaluado.

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.