pytorch / pytorch/benchmark

Refactor the t4 and a100 nightly workflows

Open
#2,368 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
1k
Forks
346
PR merge metrics
No merged PRs in 30d

Description

  • Design the PT2 Benchmark Runner based new pytorch nightly testing workflows (T4 and A100)
  • Improve the bisection workflow to support PT2 Benchmark Runner
  • Deprecate the existing v2 and v3 workflows

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by locating the existing T4 and A100 nightly workflows, the v2 and v3 workflows, and the bisection workflow. Read how they currently run benchmarks, then compare them with the PT2 Benchmark Runner requirements; done means the new nightly workflows and bisection support work and the old workflows are deprecated.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
ci-cd, performance
Issue type
Refactor
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.