Clarify missing SM100 sync-object factory errors in custom CuTe pipelines
Open
Nobody has claimed this yet.
Customized kernels
- Dominant language
- Python
- Stars
- 14.7k
- Forks
- 2.8k
- Avg merge
- 2d 23h
- Merged PRs (30d)
- 489
Description
Summary
Update the CuTe DSL sync-object factory selection in tensorrt_llm/_torch/cute_dsl_kernels/blackwell/custom_pipeline.py.
The current fallback assigns PipelineAsync._make_sync_object when cutlass.pipeline.sm100.PipelineTmaUmma._make_sync_object is unavailable. That fallback does not support PipelineOp.TCGen05Mma. The affected custom pipelines can then fail with an assertion that does not identify the missing SM100 factory.
Required changes
- Do not fall back to
PipelineAsync._make_sync_objectfor the custom UMMA pipelines. - Raise a clear import-time or runtime error when
cutlass.pipeline.sm100.PipelineTmaUmmaor its_make_sync_objectfactory is unavailable. - Ensure
PipelineTmaUmma.create,PipelineUmmaAsync.create, andPipelineCpAsyncUmma.createreport the dependency problem clearly.
Rationale
The current merge-back matches the validated source branch. Track the compatibility improvement separately with the kernel author.
Affected area
tensorrt_llm/_torch/cute_dsl_kernels/blackwell/custom_pipeline.py
Acceptance criteria
- Unsupported CuTe DSL installations fail with an explicit and actionable error.
- Supported installations continue to use the SM100 sync-object factory.
- The custom pipelines do not select
PipelineAsync._make_sync_objectforPipelineOp.TCGen05Mma.
Backlinks
- Pull request: https://github.com/NVIDIA/TensorRT-LLM/pull/18369
- Review discussion: https://github.com/NVIDIA/TensorRT-LLM/pull/18369#discussion_r3881387655
- Requested by: @farazkh80
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.