Distributed Training with TensorFlow Java

Please make sure that this is a feature request. As per our GitHub Policy, we only address code/doc bugs, performance issues, feature requests and build/installation issues on GitHub. tag:feature_template

System information

• TensorFlow version (you are using): 2.X
• Are you willing to contribute it (Yes/No): Yes, when able and available

Describe the feature and the current behavior/state.
Tensorflow on Python has tf.distribute.Strategy API to distribute training across multiple GPUs or multiple machines.

Will this change the current api? How?
Yes, it will add a new awesome feature

Who will benefit with this feature?

• Anyone that requires to speed up training a DL model
• Anyone that requires to train a DL model with big data
• Anyone who wants to create or add Java support for APIs that leverages tf.distribute.Strategy such as TensorflowOnSpark, Spark Tensorflow Distributor or Horovod

Any Other info.
https://www.tensorflow.org/guide/distributed_training

まず TensorFlow の分散トレーニングガイドを読み、このリポジトリの Java バインディングとその tf.distribute.Strategy API を比較します。どの分散トレーニング機能と Java API サーフェスを対象範囲とするかを判断し、実装前にマルチ GPU または複数マシンでのトレーニングを実証するテストや例を定義します。