Shader Object: dear imgui fails to display properly when using layer

Dear imgui fails to display when using VK_LAYER_KHRONOS_shader_object. This only happens if they layer is enabled and you are drawing dear imgui after a draw that was using a shader object. Dear imgui renders fine when using a gpu with VK_EXT_shader_object support. No validation errors are given.