Adjust blend priority to make new face mask more prominent?

Hi, I'm trying to figure out if its somehow possible to adjust the blending between the source and destination face. The detection/replacement itself works fine, but I would like to preserve the color of the new face and give it also a bit more priority. Depending on the source image/video I feel that some results still have too much features/similarities to the original source and I would like to figure out if its somehow possible to preserve more infos from the new face.

Would be great if someone could point me towards the corresponding modules that have the most influence on the visual outcome of the swap.