deepseek-ai / deepseek-ai/DeepEP

[intranode] when num_tokens change to 65536, then check failed

Open
#127 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Cuda
Stars
10.1k
Forks
1.4k
Avg merge
4d 1h
Merged PRs (30d)
2

Description

HI

does intranode support num_tokens to 64K ?
we met mismatch assert as below

File "/workspace/DeepEP/tests/test_intranode.py", line 135, in test_main
assert calc_diff(check_x, ref_x) < 5e-6
AssertionError

Thanks

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.