How to reduce time consumption

I run on H20 GPU and change following inference configs:
stage1 inference_steps = 10
stage2 inference_steps = 1
decode_formats=['gaussian']
other configs unchanged. now the average inference time of single mask is 3.5s.
What other methods can I use to further reduce inference time while having minimal impact on the reconstruction quality? Also, is it possible to perform batch inference?