microsoft / microsoft/pai

[Bug] Network traffic monitor

Open
#4,834 0 comments 0 reactions 1 assignee View on GitHub

@Binyang2014 is already working on this.

Since Aug 26, 2020.

Dominant language
JavaScript
Stars
2.7k
Forks
554
Avg merge
20h 42m
Merged PRs (30d)
14

Description

Organization Name: Microsoft

Short summary about the issue/question:
I submit a job that occupies a whole GPU node. Basically, this job trains a classification model on imagenet, and the imagenet dataset is stored on the corresponding nfs storage. I want to monitor the network bandwidth consumed by this job and find that the consumed network bandwidth is zero.
image
Then I change to the node-view and find that the consumed network bandwidth is not zero this time(the job started at 11.05). So I think the network bandwidth monitoring script may have some bugs.
image

Brief what process you are following:

How to reproduce it:

OpenPAI Environment:

  • OpenPAI version:
  • Cloud provider or hardware configuration:
  • OS (e.g. from /etc/os-release):
  • Kernel (e.g. uname -a):
  • Hardware (e.g. core number, memory size, storage size, GPU type etc.):
  • Others:

Anything else we need to know:

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.