vLLM (0.11.0>=) is not working with Dolphin. Got the following issue: ModuleNotFoundError: No module named 'vllm.model_executor.models.bart'

I followed the steps as is for using vllm with Dolphin. I installed the plugins as described in the documentation here: . I'll try downgrading vllm and hopefully it will work - but just wanted to call this out. https://github.com/bytedance/Dolphin/tree/master/deployment/vllm.

Start with the deployment/vllm documentation linked in the issue and reproduce the reported ModuleNotFoundError using vLLM 0.11.0 or newer. Check whether the documented installation steps still match that version and compare the result with the reported downgrade workaround. Done means the documented Dolphin vLLM setup works without the missing bart module error, or the supported version requirement is clearly documented.

Written by the indexing model from the issue text.