deepseek-ai / deepseek-ai/DeepEP
[intranode] when num_tokens change to 65536, then check failed
Open
- Dominant language
- Cuda
- Stars
- 10.1k
- Forks
- 1.4k
- Avg merge
- 4d 1h
- Merged PRs (30d)
- 2
Description
HI
does intranode support num_tokens to 64K ?
we met mismatch assert as below
File "/workspace/DeepEP/tests/test_intranode.py", line 135, in test_main
assert calc_diff(check_x, ref_x) < 5e-6
AssertionError
Thanks
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.