llvm / llvm/torch-mlir

Run PyTorch end-to-end op correctness tests

Open
#1,876 1 comment 1 reaction 1 assignee View on GitHub

@ramiro050 is already working on this.

Since Feb 13, 2023.

Dominant language
C++
Stars
1.9k
Forks
736
Avg merge
5d 22h
Merged PRs (30d)
15

Description

Chillee pointed me at this code for how to run the PyTorch official op-level correctness tests.

https://github.com/pytorch/pytorch/blob/701412a4ec2602b5cb3a2fabbb74e43e51defcde/test/test_proxy_tensor.py#L1468

We should do something similar for Torch-MLIR. We should probably go through the dynamo integration only to allow us to easily tests both static and dynamic shapes easily, and to be forward-looking.

Additionally, looking forward a bit more, we can retire most of our e2e tests. Some will remain, such as scalar/list ops and resnet/etc.

Assigning to Ramiro to scope and prioritize.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.