allenai / allenai/ScienceWorld
It seems wait is enough to let the model complete the task
Đang mở
- Ngôn ngữ chính
- Scala
- Star
- 391
- Fork
- 42
- Chỉ số merge pull request
- Không có pull request nào được merge trong 30 ngày
Mô tả
I recently ran several RL experiments using this environment, but I found that my policy model tends to output the wait action repeatedly. In the current setup, a single wait action advances the environment by 10 iterations/steps, and if the agent performs more than 10 consecutive waits, the environment automatically considers the task completed.
I’m trying to understand how to address this issue. How can I prevent the model from overusing the wait action or adjust the environment so this doesn’t prematurely end the task?
Hướng dẫn đóng góp
Chưa lập chỉ mục được hướng dẫn đóng góp cho kho mã nguồn này
Đánh giá
Issue này chưa được đánh giá.