[Discussion] Second stage model to make stems sound less "AI-like"

My main problem with the current spleeter outputs is that they have a lot of weird artifacts and inconsistencies. My idea is to have a second model for each output the current spleeter generates and train it with the original version.

In other words, train the second model to turn the weird result of the currently existing model into the original. Is this idea any usable? Unfortunately, I don't have any experience in tensorflow, or any other AI frameworks, so I can't try it on my own,