allenai / allenai/RL4LMs

NLPO Code Error and Query About gymnasium vs gym Usage

Ouverte
#63 0 commentaires 0 réactions 0 personnes assignées Voir sur GitHub
Langage dominant
Python
Étoiles
2.4k
Forks
201
Métriques de merge des PR
Aucune PR mergée en 30 j

Description

I hope this message finds you well. I am writing to report an issue I encountered in the NLPO project that you maintain on GitHub.

While executing the following block of code, in lines 278 of nlpo.py:
if eval_env is not None and self.seed is not None:
eval_env.seed(self.seed)
eval_env = self._get_eval_env(eval_env)
if not self._custom_logger:

I got:eval_env = self._get_eval_env(eval_env)
AttributeError: 'NLPO' object has no attribute '_get_eval_env'.

I also found that no code related to '_get_eval_env'. in this repository, did i miss some key files? IF yes please let me know.

In addition to this, I have a query regarding library usage. I would like to know if it's possible to use 'gymnasium' in place of 'gym' within the NLPO project. If so, could you please guide on how to substitute all relevant 'gym' imports to 'gymnasium'?

Guide de contribution

Aucun guide de contribution indexé pour ce dépôt

Évaluation

Cette issue n'a pas encore été évaluée.

Recevez les nouvelles issues par e-mail

Un résumé court des issues GitHub adaptées aux débutants.