NVIDIA / NVIDIA/TensorRT-LLM

Clarify missing SM100 sync-object factory errors in custom CuTe pipelines

Open
#18,376 0 comments 0 reactions 1 assignee View on GitHub

Nobody has claimed this yet.

Customized kernels
Dominant language
Python
Stars
14.7k
Forks
2.8k
Avg merge
2d 23h
Merged PRs (30d)
489

Description

Summary

Update the CuTe DSL sync-object factory selection in tensorrt_llm/_torch/cute_dsl_kernels/blackwell/custom_pipeline.py.

The current fallback assigns PipelineAsync._make_sync_object when cutlass.pipeline.sm100.PipelineTmaUmma._make_sync_object is unavailable. That fallback does not support PipelineOp.TCGen05Mma. The affected custom pipelines can then fail with an assertion that does not identify the missing SM100 factory.

Required changes

  • Do not fall back to PipelineAsync._make_sync_object for the custom UMMA pipelines.
  • Raise a clear import-time or runtime error when cutlass.pipeline.sm100.PipelineTmaUmma or its _make_sync_object factory is unavailable.
  • Ensure PipelineTmaUmma.create, PipelineUmmaAsync.create, and PipelineCpAsyncUmma.create report the dependency problem clearly.

Rationale

The current merge-back matches the validated source branch. Track the compatibility improvement separately with the kernel author.

Affected area

  • tensorrt_llm/_torch/cute_dsl_kernels/blackwell/custom_pipeline.py

Acceptance criteria

  • Unsupported CuTe DSL installations fail with an explicit and actionable error.
  • Supported installations continue to use the SM100 sync-object factory.
  • The custom pipelines do not select PipelineAsync._make_sync_object for PipelineOp.TCGen05Mma.

Backlinks

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.