allenai / allenai/ScienceWorld

It seems wait is enough to let the model complete the task

Aperta
#79 1 commento 0 reazioni 0 assegnatari Vedi su GitHub
Lingua principale
Scala
Stelle
391
Fork
42
Metriche di merge delle PR
Nessuna PR unita negli ultimi 30g

Descrizione

I recently ran several RL experiments using this environment, but I found that my policy model tends to output the wait action repeatedly. In the current setup, a single wait action advances the environment by 10 iterations/steps, and if the agent performs more than 10 consecutive waits, the environment automatically considers the task completed.

I’m trying to understand how to address this issue. How can I prevent the model from overusing the wait action or adjust the environment so this doesn’t prematurely end the task?

Guida per i contributori

Nessuna guida per i contributori indicizzata per questo repository

Valutazione

Questa issue non è ancora stata valutata.

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.