deepseek-ai / deepseek-ai/DeepEP

Why minimum Byte Size Forced to 2 when calculation hidden bytes for FP8 in get_hidden_bytes()

Open
#175 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Cuda
Stars
10.1k
Forks
1.4k
Avg merge
4d 1h
Merged PRs (30d)
2

Description

in https://github.com/deepseek-ai/DeepEP/blob/main/README.md Interfaces and examples section,

def get_hidden_bytes(x: torch.Tensor) -> int:
t = x[0] if isinstance(x, tuple) else x
return t.size(1) * max(t.element_size(), 2)

FP8 tensors use 1 byte per element, but the function forces a 2-byte minimum,Is there a memory/performance trade-off?

Contributor guide

No contributing guide indexed for this repository

Research direction

Read README.md's Interfaces and examples section and inspect get_hidden_bytes(). Start by tracing how its result is used for FP8 tensors and compare the memory and performance implications of the two-byte minimum. Done means the rationale for max(t.element_size(), 2) is established and clearly explained in the issue or documentation.

Written by the indexing model from the issue text.

Assessment

Tech stack
pytorch
Domain
documentation, performance
Issue type
Documentation
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
28/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.