google-deepmind / google-deepmind/scalable_agent

Reproduction of 80K/sec throughput

Open
#14 15 comments 1 reaction 0 assignees View on GitHub
Dominant language
Python
Stars
1k
Forks
160
PR merge metrics
No merged PRs in 30d

Description

Hi, I tried to reproduce the 80K/sec throughput reported in the paper, but only got around 22K/sec.

I ran the single learner on a GPU machine (the GPU is P40):
```
python experiment.py --job_name=learner --task=0 --num_actors=150 \
--level_name=rooms_keys_doors_puzzle --batch_size=32 \
--entropy_cost=0.0033391318945337044 \
--learning_rate=0.00031866995608948655 \
--total_environment_frames=10000000000 --reward_clipping=soft_asymmetric
```

and ran 150 actors each on a CPU machine (each one is actually a docker machine in remote allocated by a cloud service):
```
python experiment.py --job_name=actor --task=$i \
--num_actors=150 --level_name=rooms_keys_doors_puzzle
```
where `i` denotes the i-th actor.

Could you give some hints on how to reproduce the throughput? Did you require a proprietary intra net connection?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.