[Bug]: 4.57版本的transformers跑llamafactory开启EP后报错

Checklist

• 1. I have searched the existing issues (https://gitcode.com/mindspore/hyper-parallel/issues)
• 2. I have read the relevant documentation.
• 3. I have created a minimal reproduction case that clearly demonstrates the issue, including a complete code example and the error message with full traceback and error logs.

🐛 Describe the bug

不同transformers代码许多model shape定义、函数接口不一致，导致不兼容。例如 Qwen3VL模型：

1. 专家参数定义不一致
   
   
2. router的返回参数数量、含义不同

涉及代码：

1. hyper_parallel/integration/llamafactory/expert_parallel/models/qwen3_vl_moe.py
2. hyper_parallel/integration/llamafactory/utils.py

Expected behavior

兼容4.57.x版本transformers

Additional context

Environment info

transformers 4.57.3

Thanks for contributing 🎉!

schema_version: 1
source: gitcode
gitcode_repo: mindspore/hyper-parallel
gitcode_issue: 380
source_url: https://gitcode.com/mindspore/hyper-parallel/issues/380

Start with hyper_parallel/integration/llamafactory/expert_parallel/models/qwen3_vl_moe.py and hyper_parallel/integration/llamafactory/utils.py, then reproduce the failure with transformers 4.57.3 and LLaMAFactory using expert parallelism. Compare the Qwen3VL expert parameter definitions and router return values with the integration assumptions; done means the Qwen3VL path works with transformers 4.57.x without the reported error.