Problem with Tensor Virtual Machine (TVM)

Hi,

Nice work! Very interesting and useful!

I didn't know the Tensor Virtual Machine (TVM) before. And I check the blog about TVM. https://tvm.apache.org/2020/07/14/bert-pytorch-tvm

From my understanding, I don't think the original design of TVM can only compute and store the non-zero value. So does it is your implementation that makes Longformer only compute
and store the non-zero values? I want to try this idea on our own model. Could you give me more hint about how does your model achieve that?

Best,
Ye