[Usage]: Why topkperrow_prefill use radix sort for row_idx > 12288?

System Info

trtllm write a great topk per row kernel, and I have some questions about prefill version

why we choose radix sort when numrows > 12288?, can we still use insertion sort for row_idx > 12288 data?...

How would you like to use TensorRT-LLM

I want to run inference of a [specific model](put Hugging Face link here). I don't know how to integrate it with TensorRT-LLM or optimize it for my use case.

Specific questions:

• Model:
• Use case (e.g., chatbot, batch inference, real-time serving):
• Expected throughput/latency requirements:
• Multi-GPU setup needed:

Before submitting a new issue...

• Make sure you already searched for relevant issues, and checked the documentation and examples for answers to frequently asked questions.