Cartpole example is not working in colab.
- Dominant language
- Jupyter Notebook
- Stars
- 10.9k
- Forks
- 1.4k
- PR merge metrics
- No merged PRs in 30d
Description
Cartpole example
https://colab.research.google.com/github/google/dopamine/blob/master/dopamine/colab/cartpole.ipynb
Is pretty much out of date...
Using it's code on C51, it throws this error on my local machine:
```
~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~
RuntimeError: in user code:
File "/home/arre/Code/Syncd/exchange_downloader/snek/.venv/lib/python3.11/site-packages/dopamine/discrete_domains/gym_lib.py", line 297, in call *
q_values = tf.reduce_sum(self.support * probabilities, axis=2)
RuntimeError: x: Attempting to capture an EagerTensor without building a function.
In call to configurable 'DQNAgent' ()
In call to configurable 'RainbowAgent' ()
In call to configurable 'create_agent' ()
In call to configurable 'Runner' ()
In call to configurable 'TrainRunner' ()
In call to configurable 'create_runner' ()
```
On colab, I can't even get there, because there's an PIP version installed, and that doesn't works. Only github version works with DQN example, but C51 example is non-functional.
Contributor guide
Assessment
This issue has not been assessed yet.