Expand test-suite to torch part of codebase

The initial test-suite was based on the (in hindsight wrong) assumption that we can easily drop the torch-backend downstream (and/or won't need it at all for a fully rested mvp workflow).

De facto we need to torch backend now and should expand the test-suite to include all torch code in the repo as well.