google / google/tunix

How to train on multi host tpu pod

Open
#560 25 comments 0 reactions 1 assignee Claimed by @tianshub View on GitHub
type:support
Dominant language
Python
Stars
2.5k
Forks
345
Avg merge
1d 7h
Merged PRs (30d)
240

Description

How to train on multi host tpu pod like TPUv4-32? It says I need to ssh into every machine but I am confused how it works for Tunix library specifically

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.