google / google/dopamine

Cartpole example is not working in colab.

Open
#212 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
10.9k
Forks
1.4k
PR merge metrics
No merged PRs in 30d

Description

Cartpole example

https://colab.research.google.com/github/google/dopamine/blob/master/dopamine/colab/cartpole.ipynb

Is pretty much out of date...

Using it's code on C51, it throws this error on my local machine:

```
~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~
RuntimeError: in user code:

File "/home/arre/Code/Syncd/exchange_downloader/snek/.venv/lib/python3.11/site-packages/dopamine/discrete_domains/gym_lib.py", line 297, in call *
q_values = tf.reduce_sum(self.support * probabilities, axis=2)

RuntimeError: x: Attempting to capture an EagerTensor without building a function.

In call to configurable 'DQNAgent' ()
In call to configurable 'RainbowAgent' ()
In call to configurable 'create_agent' ()
In call to configurable 'Runner' ()
In call to configurable 'TrainRunner' ()
In call to configurable 'create_runner' ()
```

On colab, I can't even get there, because there's an PIP version installed, and that doesn't works. Only github version works with DQN example, but C51 example is non-functional.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.