allenai / allenai/allenact

Logging losses on the validation / test split

未关闭
#203 3 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
enhancement
主要语言
Python
星标
383
派生
59
PR 合并指标
30 天内没有已合并 PR

描述

## Problem

I think right now logging losses (PPO or otherwise) as defined under `core/algorithms/onpolicy_sync/losses/` is only supported on the train split. If I understand correctly, right now on the train split, it's possible to log losses (and other quantities defined in the loss definitions -- policy entropy, etc.) as well as metrics (and rewards) defined in the task definitions (success, SPL, etc. under `plugins/robothor_plugin/robothor_tasks.py` for instance). However, on val, only logging the latter is supported. While logging loss values (and other quantities defined in loss definitions) on val may not be super-useful in case of PPO, but may be worthwile for debugging experiments that have additional custom defined losses (action-prediction, etc.).

## Desired solution

To be able to observe loss (and other quantities defined under loss definitions) on the val split in the tensorboard logs.

贡献指南

打开贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。