Sensor never starts streaming data 70% of the time on X1 Carbon Gen 11

I have an X1 Carbon Gen 11 21HMCTO1WW with an ov2740 sensor.

I am running the latest 6.5.5 kernel with the Fedora driver stack from https://hansdegoede.livejournal.com/27276.html
```
Linux fedora 6.5.5-200.fc38.x86_64 #1 SMP PREEMPT_DYNAMIC Sun Sep 24 15:52:44 UTC 2023 x86_64 GNU/Linux
```

Very often the stream just fails to start streaming. I can run `sudo gst-launch-1.0 icamerasrc ! autovideosink` 10 times in a row and on average, I will only get a video stream 3/10 times. The webcam works reliably in Windows so I doubt it's a hardware problem. The exact same software stack works more reliably on an X1 Yoga Gen 8 with the same sensor (different hardware configuration though, the Yoga has a i7-1370P CPU and the Carbon has a i7-1365U).

`dmesg -w` while doing this shows the following pattern:


Here you can see when it worked (on, off with no red errors), and when it didn't (timeouts), from `dmesg -w`.

Here's the output from running sudo gst-launch-1.0 icamerasrc ! autovideosink > gst-1.txt 2>&1 one time that it didn't work:
https://gist.github.com/lukemarsden/d51e5f438d72f3211c402ea4e9af7cf6

And the journal from that time: sudo journalctl -f > journal-1.txt 2>&1:
https://gist.github.com/lukemarsden/a5022bebdadaa5ae34aab822aff636b9

The only log lines that seem interesting are the timeouts from gstreamer and the:
```
Oct 04 17:46:12 fedora kernel: intel-ipu6-isys intel-ipu6-isys0: stream stop time out
```
line from the ipu6 driver. That "stream stop time out" only happens _after_ I hit ctrl+c (twice) on the gstreamer stream because I'm seeing a black video feed.

dmesg |grep ipu6:
https://gist.github.com/lukemarsden/01beb5c00d37e57f71706922aa713832

I followed the instructions at https://hansdegoede.livejournal.com/27276.html

Versions:
```
akmod-intel-ipu6.x86_64 0.0-7.20230622git8e41080.fc38 @rpmfusion-nonfree-updates
ipu6-camera-bins.x86_64 0.0-7.20230208git276859f.fc38 @rpmfusion-nonfree-updates
ipu6-camera-bins-firmware.x86_64 0.0-7.20230208git276859f.fc38 @rpmfusion-nonfree-updates
ipu6-camera-hal.x86_64 0.0-14.20230208git884b81a.fc38 @rpmfusion-nonfree-updates
kmod-intel-ipu6-6.4.15-200.fc38.x86_64.x86_64 0.0-7.20230622git8e41080.fc38 @@commandline
kmod-intel-ipu6-6.5.5-200.fc38.x86_64.x86_64 0.0-7.20230622git8e41080.fc38 @@commandline
kmod-intel-ipu6-6.5.5-200.fc38.x86_64+debug.x86_64 0.0-7.20230622git8e41080.fc38 @@commandline
ipu6-camera-bins-devel.x86_64 0.0-7.20230208git276859f.fc38 rpmfusion-nonfree-updates
ipu6-camera-hal-devel.x86_64 0.0-14.20230208git884b81a.fc38 rpmfusion-nonfree-updates
kmod-intel-ipu6.x86_64 0.0-7.20230622git8e41080.fc38 rpmfusion-nonfree-updates
```

Please let me know if you need any more details or logs from my system.