[Bug]: bad image quality with ControlNet InstantID

Nobody has claimed this yet.

### Checklist

- [X] The issue exists after disabling all extensions
- [X] The issue exists on a clean installation of webui
- [ ] The issue is caused by an extension, but I believe it is caused by a bug in the webui
- [X] The issue exists in the current version of the webui
- [X] The issue has not been reported before recently
- [ ] The issue has been reported before but has not been fixed yet

### What happened?

An image created by ControlNet InstantID is blurry and oversaturated. An image generated with same parameters in the original stable-diffusion-webui looks better.

### Steps to reproduce the problem

Generate an image with the parameters:
1. Model - [Turbo Diffusion XL Turbo v1.12](https://civitai.com/models/260460/turbo-diffusion-xl-turbo)
2. Clip skip - 2
3. Positive prompt - _frog hat, movie scene_
4. Negative prompt - _lowres, text, error, cropped, worst quality, low quality, jpeg artifacts, ugly, duplicate, morbid, mutilated, out of frame, extra fingers, mutated hands, poorly drawn hands, poorly drawn face, mutation, deformed, blurry, dehydrated, bad anatomy, bad proportions, extra limbs, cloned face, disfigured, gross proportions, malformed limbs, missing arms, missing legs, extra arms, extra legs, fused fingers, too many fingers, long neck, username, watermark, signature_
5. Sampling method - DPM++ SDE Karras
6. Sampling Steps - 8
7. Width x height - 1024 x 1024
8. CFG Scale - 3
9. Seed - 1309353952
10. ControlNet Unit 0:
- Image: [photo_0.png](https://github.com/lllyasviel/stable-diffusion-webui-forge/assets/18257858/b969d273-a6dc-488a-abdd-4c7fb93c890f)
- Pixel Perfect
- Preprocessor: InsightFace(InstantID)
- Model: ip-adapter_instant_id_sdxl [eb2d3ec0]
11. ControlNet Unit 1:
- Image: [photo_1.png](https://github.com/lllyasviel/stable-diffusion-webui-forge/assets/18257858/212c4266-f7bd-4fbb-ac93-dac1c02a0b1e)
- Pixel Perfect
- Preprocessor: instant_id_face_keypoints
- Model: control_instant_id_sdxl [c5c25a50]
- Control Mode: ControlNet is more important

The result is a blury oversaturated image.

```
frog hat, movie scene
Negative prompt: lowres, text, error, cropped, worst quality, low quality, jpeg artifacts, ugly, duplicate, morbid, mutilated, out of frame, extra fingers, mutated hands, poorly drawn hands, poorly drawn face, mutation, deformed, blurry, dehydrated, bad anatomy, bad proportions, extra limbs, cloned face, disfigured, gross proportions, malformed limbs, missing arms, missing legs, extra arms, extra legs, fused fingers, too many fingers, long neck, username, watermark, signature
Steps: 8, Sampler: DPM++ SDE Karras, CFG scale: 3, Seed: 1309353952, Size: 1024x1024, Model hash: 1524a9699f, Model: turboDiffusionXL_v112, ControlNet 0: "Module: InsightFace (InstantID), Model: ip-adapter_instant_id_sdxl [eb2d3ec0], Weight: 1, Resize Mode: Crop and Resize, Processor Res: 0.5, Threshold A: 0.5, Threshold B: 0.5, Guidance Start: 0, Guidance End: 1, Pixel Perfect: True, Control Mode: Balanced, Hr Option: Both", ControlNet 1: "Module: instant_id_face_keypoints, Model: control_instant_id_sdxl [c5c25a50], Weight: 1, Resize Mode: Crop and Resize, Processor Res: 512, Threshold A: 0.5, Threshold B: 0.5, Guidance Start: 0, Guidance End: 1, Pixel Perfect: True, Control Mode: ControlNet is more important, Hr Option: Both", Version: f0.0.10-latest-87-gc06769c1
```

### What should have happened?

Better quality is expected.

The image generated **with the exactly same parameters** in the original stable-diffusion-webui looks much better:


```
frog hat, movie scene
Negative prompt: lowres, text, error, cropped, worst quality, low quality, jpeg artifacts, ugly, duplicate, morbid, mutilated, out of frame, extra fingers, mutated hands, poorly drawn hands, poorly drawn face, mutation, deformed, blurry, dehydrated, bad anatomy, bad proportions, extra limbs, cloned face, disfigured, gross proportions, malformed limbs, missing arms, missing legs, extra arms, extra legs, fused fingers, too many fingers, long neck, username, watermark, signature
Steps: 8, Sampler: DPM++ SDE Karras, CFG scale: 3, Seed: 1309353952, Size: 1024x1024, Model hash: 1524a9699f, Model: turboDiffusionXL_v112, Clip skip: 2, ControlNet 0: "Module: instant_id_face_embedding, Model: ip-adapter_instant_id_sdxl [eb2d3ec0], Weight: 1, Resize Mode: Crop and Resize, Low Vram: False, Processor Res: 512, Guidance Start: 0, Guidance End: 1, Pixel Perfect: True, Control Mode: Balanced, Hr Option: Both, Save Detected Map: True", ControlNet 1: "Module: instant_id_face_keypoints, Model: control_instant_id_sdxl [c5c25a50], Weight: 1, Resize Mode: Crop and Resize, Low Vram: False, Processor Res: 512, Guidance Start: 0, Guidance End: 1, Pixel Perfect: True, Control Mode: ControlNet is more important, Hr Option: Both, Save Detected Map: True", Version: v1.7.0-455-gd69a7944
```

### What browsers do you use to access the UI ?

Google Chrome

### Sysinfo

[sysinfo-2024-02-09-19-56.json](https://github.com/lllyasviel/stable-diffusion-webui-forge/files/14225820/sysinfo-2024-02-09-19-56.json)

### Console logs

```Shell
https://pastebin.com/DXdPkjab
```

### Additional information

_No response_

No source file or test is named. Start by reproducing the supplied ControlNet InstantID configuration, then compare the Forge output with the original stable-diffusion-webui output using the same seed and parameters; inspect the linked sysinfo and console log for differences. Done means the quality discrepancy is isolated and a verified correction is demonstrated with this reproduction.

Written by the indexing model from the issue text.