Azure / Azure/MachineLearningNotebooks

Slow performance issue with the Pytorch Horovod example

未关闭
#1,237 0 条评论 0 个 reaction 已指派 1 人 已被 @mx-iao 认领 在 GitHub 查看
ADO product-issue Training
主要语言
Jupyter Notebook
星标
4.4k
派生
2.6k
PR 合并指标
30 天内没有已合并 PR

描述

In the `DataLoader` instantiation step, you need to pass `num_workers > 0` (4 caused a 2x-speedup for me on a 4 core node) to have a performance higher than the single node execution. Without this parameter passed to the `DataLoader` constructor, the performance is slower than the single `MNIST` example.

Link to the file: [https://github.com/Azure/MachineLearningNotebooks/blob/master/how-to-use-azureml/ml-frameworks/pytorch/distributed-pytorch-with-horovod/pytorch_horovod_mnist.py](https://github.com/Azure/MachineLearningNotebooks/blob/master/how-to-use-azureml/ml-frameworks/pytorch/distributed-pytorch-with-horovod/pytorch_horovod_mnist.py)

Line: 62 and 72.

贡献指南

这个仓库没有索引到贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。