google-deepmind / google-deepmind/disco_rl

[Community Resource] PyTorch Port of Disco103 Validated on Catch

Open
#6 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
733
Forks
61
PR merge metrics
No merged PRs in 30d

Description

Here is a PyTorch port of the Disco103 update rule:

https://github.com/asystemoffields/disco-torch

pip install disco-torch

The port loads the pretrained disco_103.npz weights and reproduces the reference Catch benchmark (99% catch rate at
1000 steps). All meta-network outputs match the JAX implementation within float32 precision (<1e-6 max diff), and the
full value pipeline is verified (14 fields, <6e-4 max diff).

It includes a high-level DiscoTrainer API that handles meta-state management, target networks, replay buffer, and the
training loop:

from disco_torch import DiscoTrainer, collect_rollout

trainer = DiscoTrainer(agent, device=device)
for step in range(1000):
rollout, obs, state = collect_rollout(agent, step_fn, obs, state, 29, device)
logs = trainer.step(rollout)

Sharing in case it's useful to the community. Slàinte!

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.