google / google/flax

PJit example

Open
#1,763 2 comments 0 reactions 0 assignees View on GitHub
Priority: P2 - no schedule
Dominant language
Jupyter Notebook
Stars
7.3k
Forks
833
Avg merge
5h 11m
Merged PRs (30d)
5

Description

### Description of the model to be implemented
ResNet18

### Dataset the model could be trained on
tensorflow_datasets mock_data, e.g.
```
with tfds.testing.mock_data(num_examples=128):
ds = tfds.load('imagenette', split='train')
```

### Specific points to consider

- The existing ImageNet example uses pmap. It is not trivial to replace pmap with pjit in the existing example. A pure pjit example would be great to learn from.
- The example should be functional also on a GPU host for the benefit of the broader community.

### Reference implementations in other frameworks
https://github.com/google/flax/blob/main/examples/imagenet/imagenet.ipynb

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.