Longformer reshape simplification
Open
@shivadbhavsar is already working on this.
Since May 30, 2024.
Perf Improve
- Dominant language
- C++
- Stars
- 333
- Forks
- 150
- Avg merge
- 4d 19h
- Merged PRs (30d)
- 54
Description
Following pattern seen in Longformer:
@1473 = gpu::code_object[code_object=7552,symbol_name=mlir_reshape_reshape_transpose_reshape_dot,global=589824,local=256,](@1463,@1460,@1472) -> half_type, {144, 512, 512}, {262144, 512, 1}: 0.0601688ms, 1%
@1474 = reshape_lazy[dims={48, 3, 512, 1, 512}](@1473) -> half_type, {48, 3, 512, 1, 512}, {786432, 262144, 512, 512, 1}: 0.0006914ms, 1%
@1475 = transpose[permutation={0, 1, 2, 4, 3}](@1474) -> half_type, {48, 3, 512, 512, 1}, {786432, 262144, 512, 1, 512}: 0.00062502ms, 1%
@1476 = reshape_lazy[dims={48, 3, 512, 512}](@1475) -> half_type, {48, 3, 512, 512}, {786432, 262144, 512, 1}: 0.00064048ms, 1%
This should be simplified to a single reshape. Might be fixed by #3104
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.