AttributeError: Compiling Error! Cannot locate the function: xtuner.v1.float8.triton_kernels.per_block_quant_gemm.per_block_quant_torch
Open
- Dominant language
- Python
- Stars
- 5.2k
- Forks
- 448
- Avg merge
- 3d 15h
- Merged PRs (30d)
- 26
Description
运行torchrun xtuner/v1/train/cli/sft.py --config examples/v1/config/sft_intern_s1_tiny_config.py的时候报错
[rank0]: AttributeError: Compiling Error! Cannot locate the function: xtuner.v1.float8.triton_kernels.per_block_quant_gemm.per_block_quant_torch
xtuner:0.2.0
grouped_gemm:1.1.4
Contributor guide
Research direction
Reproduce the failure with the reported torchrun command and config at examples/v1/config/sft_intern_s1_tiny_config.py. Then inspect xtuner.v1.float8.triton_kernels.per_block_quant_gemm and the referenced per_block_quant_torch entry point, using the listed xtuner and grouped_gemm versions; done means the function is located and the command proceeds past this compilation error.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, pytorch
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Active
- Clarity
- Needs clarification
- Newbie friendliness
- 38/100