[Bug]: 4.57版本的transformers跑llamafactory开启EP后报错

Checklist

• 1. I have searched the existing issues (https://gitcode.com/mindspore/hyper-parallel/issues)
• 2. I have read the relevant documentation.
• 3. I have created a minimal reproduction case that clearly demonstrates the issue, including a complete code example and the error message with full traceback and error logs.

🐛 Describe the bug

不同transformers代码许多model shape定义、函数接口不一致，导致不兼容。例如 Qwen3VL模型：

1. 专家参数定义不一致

2. router的返回参数数量、含义不同

涉及代码：

1. hyper_parallel/integration/llamafactory/expert_parallel/models/qwen3_vl_moe.py
2. hyper_parallel/integration/llamafactory/utils.py

Expected behavior

兼容4.57.x版本transformers

Additional context

Environment info

transformers 4.57.3

Thanks for contributing 🎉!

schema_version: 1
source: gitcode
gitcode_repo: mindspore/hyper-parallel
gitcode_issue: 380
source_url: https://gitcode.com/mindspore/hyper-parallel/issues/380

Start with hyper_parallel/integration/llamafactory/expert_parallel/models/qwen3_vl_moe.py and hyper_parallel/integration/llamafactory/utils.py, then inspect the Qwen3VL integration against transformers 4.57.3. Reproduce the failure with LlamaFactory and expert parallelism enabled, focusing on expert parameter definitions and router return values. Done means Qwen3VL is compatible with transformers 4.57.x.