allenai / allenai/ScienceWorld

It seems wait is enough to let the model complete the task

Ouverte
#79 1 commentaire 0 réactions 0 personnes assignées Voir sur GitHub
Langage dominant
Scala
Étoiles
391
Forks
42
Métriques de merge des PR
Aucune PR mergée en 30 j

Description

I recently ran several RL experiments using this environment, but I found that my policy model tends to output the wait action repeatedly. In the current setup, a single wait action advances the environment by 10 iterations/steps, and if the agent performs more than 10 consecutive waits, the environment automatically considers the task completed.

I’m trying to understand how to address this issue. How can I prevent the model from overusing the wait action or adjust the environment so this doesn’t prematurely end the task?

Guide de contribution

Aucun guide de contribution indexé pour ce dépôt

Évaluation

Cette issue n'a pas encore été évaluée.

Recevez les nouvelles issues par e-mail

Un résumé court des issues GitHub adaptées aux débutants.