pytorch / pytorch/benchmark

bug for DCGM fp32 metric collection

Open
#1,285 0 comments 0 reactions 1 assignee View on GitHub

@FindHao is already working on this.

Since Nov 7, 2022.

bug
Dominant language
Python
Stars
1k
Forks
346
PR merge metrics
No merged PRs in 30d

Description

When there are multiple metrics, the DCGM API may return -1 values for some metrics. In general, most metrics use max as the default aggregator function while our FP32 metric use mean. It will introduce wrong values when DCGM returns -1. Update the FP32 aggregator function to fix this.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.