"How to create and train a custom agent" doesn't actually do any learning

The Colab notebook showing how to train a custom agent (https://colab.research.google.com/github/google/dopamine/blob/master/dopamine/colab/agents.ipynb) doesn't actually do any learning. Could we have an example of modifying the DQN architecture or its loss function?