Azure / Azure/MachineLearningNotebooks
Slow performance issue with the Pytorch Horovod example
- Lenguaje dominante
- Jupyter Notebook
- Estrellas
- 4.4k
- Forks
- 2.6k
- Métricas de merge de PR
- Sin PR fusionados en 30 d
Descripción
In the `DataLoader` instantiation step, you need to pass `num_workers > 0` (4 caused a 2x-speedup for me on a 4 core node) to have a performance higher than the single node execution. Without this parameter passed to the `DataLoader` constructor, the performance is slower than the single `MNIST` example.
Link to the file: [https://github.com/Azure/MachineLearningNotebooks/blob/master/how-to-use-azureml/ml-frameworks/pytorch/distributed-pytorch-with-horovod/pytorch_horovod_mnist.py](https://github.com/Azure/MachineLearningNotebooks/blob/master/how-to-use-azureml/ml-frameworks/pytorch/distributed-pytorch-with-horovod/pytorch_horovod_mnist.py)
Line: 62 and 72.
Guía de contribución
No hay ninguna guía de contribución indexada para este repositorio
Evaluación
Este issue todavía no se ha evaluado.