alibaba / alibaba/BladeDISC

PyTorch2.0 TorchMLIR based compilation

Open
#999 0 comments 0 reactions 2 assignees Claimed by @zzpmiracle View on GitHub
Dominant language
C++
Stars
933
Forks
169
PR merge metrics
No merged PRs in 30d

Description

**Describe the solution you'd like**
TorchBlade currently supports PT2.0 through the TorchScript subgraph. But we found TorchScript in PT2.0 is not stable.
Althrough, we can leverage the foundation's works of TorchScript on compilation and optimization, the conversion pipeline `Fx Graph -> TorchScript -> Backends` might not be a long-term consideration.

Torch-MLIR is now working on converting `Fx Graph` directly to MLIR, which looks good to me. But there is something that should be addressed before we decide to shift into this roadmap:

- [ ] How the pipeline is designed in Torch-MLIR
- [ ] What about the usability and robustness, and coverage of the path
- [ ] The shape inference and dynamic shape support in the pipeline, see: https://github.com/llvm/torch-mlir/blob/main/docs/abstract_interp_lib.md
- [ ] The estimated efforts and long-term support
- [ ] The relations to other paths such as inductor

@zzpmiracle @Yancey1989 @qiuxiafei

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.