Profiling when rank unbalance

Thank you very much for your contributions to the DeepEP! I have a question about the latency of batch per rank unbalance scenario.

The above figure is my theoretical estimation of the impact of different RANK's batch size per rank on the dispatch + combine delay in the Decode stage. According to the estimation, the difference in batch size per rank among different RANKs, that is, batch size unbalance, has a very small effect on the end-to-end delay of Decode, which is about (220 - 210) / 210 = 4.7%. Is this theoretical estimation correct? It seems a bit counterintuitive. @sphish