Can we use this model to do VAD?

Hello, I found this model in VaD recently. At present, we use the voice audio separated from this model to make VAD (using neural network and LSTM). At present, I have an idea. Since this model can separate voice and background, this model should know whether this frame is voice or background, so we can make a VAD, At present, I have tried the mask matrix, but the effect is not very good. After the mask matrix is visualized, it is similar to the separated vocal spectrum. But I don't want to give up the idea. Where should I modify it

Thanks