google-deepmind / google-deepmind/rlax

Examples `online_q_learning` not working

Open
#136 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.4k
Forks
109
Avg merge
2h 15m
Merged PRs (30d)
1

Description

I' trying to run [https://github.com/google-deepmind/rlax/blob/master/examples/online_q_learning.py](url), but bsuit is not working. I get an ```AttributeError``` when trying to run

```
agent = OnlineQ(
observation_spec=env.observation_spec(),
action_spec=env.action_spec(),
num_hidden_units=FLAGS.num_hidden_units,
epsilon=FLAGS.epsilon,
learning_rate=FLAGS.learning_rate,
)
```

```
AttributeError: module 'numpy' has no attribute 'int'.
`np.int` was a deprecated alias for the builtin `int`. To avoid this error in existing code, use `int` by itself. Doing this will not modify any behavior and is safe. When replacing `np.int`, you may wish to use e.g. `np.int64` or `np.int32` to specify the precision. If you wish to review your current use, check the release note link for additional information.
The aliases was originally deprecated in NumPy 1.20; for more details and guidance see the original release note at:
https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
```

Apparently `bsuite` uses `np.int` which is deprecated, and `bsuite` does not seem to be maintained anymore. I fixed it editing it manually.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.