Look into reducing vector allocations, especially for fixed-size data like account IDs and nullifiers

We do quite a few allocations when it comes to converting types, using i.e. try_convert and other helpers and collect repeatedly.
Another instance is in the context of #1201