google-deepmind / google-deepmind/jaxline

Device selection `train_eval_multithreaded`

Open
#13 0 comments 1 reaction 0 assignees View on GitHub
Dominant language
Python
Stars
164
Forks
22
PR merge metrics
No merged PRs in 30d

Description

Hi,

I am a bit confused about the decide selection if running with `train_eval_multithreaded`. In my set up I have two GPUs and in training I use `pmap` and for evaluation I only use `jit`. How are the resources shared in this case? Since I do not explicitly select any devices, I think that here device 0 will do training and evaluation simultaneously. Is this how `jaxline` is intended/designed or am I missing something?

Thanks!

Contributor guide

Open the contributing guide

Research direction

Start at the train_eval_multithreaded entry point and trace how pmap-based training and jit-based evaluation select devices when two GPUs are available. Confirm whether device 0 can run both phases concurrently, then document the intended resource-sharing behavior and any explicit selection needed.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
distributed-systems, machine-learning
Issue type
Documentation
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.