[QUESTION] In what cases will tp_comm_overlap accelerate training

Using H20*8 to finetune Qwen3-32B with tp8 and 16384 packed_seq_len (with padding for fixed seq length as required by tp_comm_overlap userbuffer). The global batchsize is 16.

With tp_comm_overlap, it only speeds up by less than 2s/step from 43s/step, which is minor.

Are there any guides on for what model size, tp size and seq length will tp_comm_overlap be beneficial?