QSV encoder MFX_ERR_DEVICE_FAILED on Linux

Operating System Info

Ubuntu 22.04

Other OS

No response

OBS Studio Version

Git

OBS Studio Version (Other)

No response

OBS Studio Log URL

https://obsproject.com/logs/ZkkkKWsRJHD0PTT8

OBS Studio Crash Log URL

No response

Expected Behavior

Recording starts

Current Behavior

Recording fails to initiate after changing QSV encoder setting.

Steps to Reproduce

OBS git master compiled with -DENABLE_QSV11=ON. libmfx-gen1.2 is required to make QSV working.

1. Start obs. Change some QSV encoder setting(like bitrate, profile or latency) or changing from other encoder to QuickSync H264/H265. Start recording.
2. Recording fails to initiate.

Restarting OBS fixes the problem.

Anything else we should know?

The log says I'm using a modified build. I only add a plugin by add_subdirectory(obs-shaderfilter) to plugins/CMakeLists.txt but it's irrelevant to this issue. I've tried compiling without this plugin, same result.

Start by reviewing the linked OBS log and reproducing the failure on Ubuntu 22.04 with OBS git master, ENABLE_QSV11, and libmfx-gen1.2. Exercise the QSV settings changes described in the issue, including switching encoders, and compare behavior before and after restarting OBS. Done means recording starts reliably without requiring a restart.