InternLM / InternLM/xtuner

qwen2_attn_forward 中SP的开启条件为什么会加上对是否正在train的判断,Eval阶段不支持么

Open
#965 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
5.2k
Forks
448
Avg merge
3d 15h
Merged PRs (30d)
26

Description



截屏2024-11-21 19 50 12

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.