I changed my GPU from RTX 3060 to 5060 ti and now i have this TORCH INDUCTOR ERROR that won't go away
- Dominant language
- Python
- Stars
- 133k
- Forks
- 15.7k
- Avg merge
- 1d 7h
- Merged PRs (30d)
- 158
Description
I EVEN REINSTALLED triton for windows, and updated sage, and STILL get INDUCTOR ERROR, everything else works fine!!!
ERROR CODE HERE:
'sm_120' is not a recognized processor for this target (ignoring processor)
'sm_120' is not a recognized processor for this target (ignoring processor)
'sm_120' is not a recognized processor for this target (ignoring processor)
'sm_120' is not a recognized processor for this target (ignoring processor)
'sm_120' is not a recognized processor for this target (ignoring processor)
'sm_120' is not a recognized processor for this target (ignoring processor)
'sm_120' is not a recognized processor for this target (ignoring processor)
'sm_120' is not a recognized processor for this target (ignoring processor)
'sm_120' is not a recognized processor for this target (ignoring processor)
'sm_120' is not a recognized processor for this target (ignoring processor)
'sm_120' is not a recognized processor for this target (ignoring processor)
'sm_120' is not a recognized processor for this target (ignoring processor)
E0916 19:14:38.795000 9120 Lib\site-packages\torch\_inductor\runtime\triton_heuristics.py:539] [0/0_1] Triton compilation failed: triton_poi_fused_add_0
E0916 19:14:38.795000 9120 Lib\site-packages\torch\_inductor\runtime\triton_heuristics.py:539] [0/0_1] def triton_poi_fused_add_0(in_ptr0, in_ptr1, out_ptr0, xnumel, XBLOCK : tl.constexpr):
E0916 19:14:38.795000 9120 Lib\site-packages\torch\_inductor\runtime\triton_heuristics.py:539] [0/0_1] xnumel = 30720
E0916 19:14:38.795000 9120 Lib\site-packages\torch\_inductor\runtime\triton_heuristics.py:539] [0/0_1] xoffset = tl.program_id(0) * XBLOCK
E0916 19:14:38.795000 9120 Lib\site-packages\torch\_inductor\runtime\triton_heuristics.py:539] [0/0_1] xindex = xoffset + tl.arange(0, XBLOCK)[:]
E0916 19:14:38.795000 9120 Lib\site-packages\torch\_inductor\runtime\triton_heuristics.py:539] [0/0_1] xmask = xindex < xnumel
E0916 19:14:38.795000 9120 Lib\site-packages\torch\_inductor\runtime\triton_heuristics.py:539] [0/0_1] x0 = xindex
E0916 19:14:38.795000 9120 Lib\site-packages\torch\_inductor\runtime\triton_heuristics.py:539] [0/0_1] tmp0 = tl.load(in_ptr0 + (x0), xmask).to(tl.float32)
E0916 19:14:38.795000 9120 Lib\site-packages\torch\_inductor\runtime\triton_heuristics.py:539] [0/0_1] tmp1 = tl.load(in_ptr1 + (x0), xmask).to(tl.float32)
E0916 19:14:38.795000 9120 Lib\site-packages\torch\_inductor\runtime\triton_heuristics.py:539] [0/0_1] tmp2 = tmp0 + tmp1
E0916 19:14:38.795000 9120 Lib\site-packages\torch\_inductor\runtime\triton_heuristics.py:539] [0/0_1] tl.store(out_ptr0 + (x0), tmp2, xmask)
E0916 19:14:38.795000 9120 Lib\site-packages\torch\_inductor\runtime\triton_heuristics.py:539] [0/0_1]
E0916 19:14:38.795000 9120 Lib\site-packages\torch\_inductor\runtime\triton_heuristics.py:539] [0/0_1] metadata: {'signature': {'in_ptr0': '*fp16', 'in_ptr1': '*fp16', 'out_ptr0': '*fp16', 'xnumel': 'i32'}, 'device': 0, 'constants': {'XBLOCK': 256}, 'configs': [AttrsDescriptor.from_dict({'arg_properties': {'tt.divisibility': (0, 1, 2, 3), 'tt.equal_to': ()}, 'cls': 'AttrsDescriptor'})], 'device_type': 'cuda', 'num_warps': 4, 'num_stages': 1, 'debug': True, 'cc': 120}
E0916 19:14:38.795000 9120 Lib\site-packages\torch\_inductor\runtime\triton_heuristics.py:539] [0/0_1] Traceback (most recent call last):
E0916 19:14:38.795000 9120 Lib\site-packages\torch\_inductor\runtime\triton_heuristics.py:539] [0/0_1] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\triton\backends\nvidia\compiler.py", line 377, in make_cubin
E0916 19:14:38.795000 9120 Lib\site-packages\torch\_inductor\runtime\triton_heuristics.py:539] [0/0_1] subprocess.run(ptxas_cmd, check=True, close_fds=True if os.name == 'nt' else False, stdout=flog, stderr=flog)
E0916 19:14:38.795000 9120 Lib\site-packages\torch\_inductor\runtime\triton_heuristics.py:539] [0/0_1] File "subprocess.py", line 573, in run
E0916 19:14:38.795000 9120 Lib\site-packages\torch\_inductor\runtime\triton_heuristics.py:539] [0/0_1] subprocess.CalledProcessError: Command '['E:\\ComfyUI_NVME\\ComfyUI_windows_portable\\python_embeded\\Lib\\site-packages\\triton\\backends\\nvidia\\bin\\ptxas.exe', '-lineinfo', '-v', '--gpu-name=sm_120', 'C:\\Users\\eddie\\AppData\\Local\\Temp\\tmpcq973ife.ptx', '-o', 'C:\\Users\\eddie\\AppData\\Local\\Temp\\tmpcq973ife.ptx.o']' returned non-zero exit status 4294967295.
E0916 19:14:38.795000 9120 Lib\site-packages\torch\_inductor\runtime\triton_heuristics.py:539] [0/0_1]
E0916 19:14:38.795000 9120 Lib\site-packages\torch\_inductor\runtime\triton_heuristics.py:539] [0/0_1] During handling of the above exception, another exception occurred:
E0916 19:14:38.795000 9120 Lib\site-packages\torch\_inductor\runtime\triton_heuristics.py:539] [0/0_1]
E0916 19:14:38.795000 9120 Lib\site-packages\torch\_inductor\runtime\triton_heuristics.py:539] [0/0_1] Traceback (most recent call last):
E0916 19:14:38.795000 9120 Lib\site-packages\torch\_inductor\runtime\triton_heuristics.py:539] [0/0_1] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_inductor\runtime\triton_heuristics.py", line 537, in _precompile_config
E0916 19:14:38.795000 9120 Lib\site-packages\torch\_inductor\runtime\triton_heuristics.py:539] [0/0_1] binary = triton.compile(*compile_args, **compile_kwargs)
E0916 19:14:38.795000 9120 Lib\site-packages\torch\_inductor\runtime\triton_heuristics.py:539] [0/0_1] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
E0916 19:14:38.795000 9120 Lib\site-packages\torch\_inductor\runtime\triton_heuristics.py:539] [0/0_1] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\triton\compiler\compiler.py", line 283, in compile
E0916 19:14:38.795000 9120 Lib\site-packages\torch\_inductor\runtime\triton_heuristics.py:539] [0/0_1] next_module = compile_ir(module, metadata)
E0916 19:14:38.795000 9120 Lib\site-packages\torch\_inductor\runtime\triton_heuristics.py:539] [0/0_1] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
E0916 19:14:38.795000 9120 Lib\site-packages\torch\_inductor\runtime\triton_heuristics.py:539] [0/0_1] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\triton\backends\nvidia\compiler.py", line 407, in
E0916 19:14:38.795000 9120 Lib\site-packages\torch\_inductor\runtime\triton_heuristics.py:539] [0/0_1] stages["cubin"] = lambda src, metadata: self.make_cubin(src, metadata, options, self.capability)
E0916 19:14:38.795000 9120 Lib\site-packages\torch\_inductor\runtime\triton_heuristics.py:539] [0/0_1] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
E0916 19:14:38.795000 9120 Lib\site-packages\torch\_inductor\runtime\triton_heuristics.py:539] [0/0_1] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\triton\backends\nvidia\compiler.py", line 389, in make_cubin
E0916 19:14:38.795000 9120 Lib\site-packages\torch\_inductor\runtime\triton_heuristics.py:539] [0/0_1] raise RuntimeError(f'{error}\n'
E0916 19:14:38.795000 9120 Lib\site-packages\torch\_inductor\runtime\triton_heuristics.py:539] [0/0_1] RuntimeError: `ptxas` failed with error code 4294967295
E0916 19:14:38.795000 9120 Lib\site-packages\torch\_inductor\runtime\triton_heuristics.py:539] [0/0_1] `ptxas` stderr:
E0916 19:14:38.795000 9120 Lib\site-packages\torch\_inductor\runtime\triton_heuristics.py:539] [0/0_1] ptxas fatal : Value 'sm_120' is not defined for option 'gpu-name'
E0916 19:14:38.795000 9120 Lib\site-packages\torch\_inductor\runtime\triton_heuristics.py:539] [0/0_1]
E0916 19:14:38.795000 9120 Lib\site-packages\torch\_inductor\runtime\triton_heuristics.py:539] [0/0_1] Repro command: E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\triton\backends\nvidia\bin\ptxas.exe -lineinfo -v --gpu-name=sm_120 C:\Users\eddie\AppData\Local\Temp\tmpcq973ife.ptx -o C:\Users\eddie\AppData\Local\Temp\tmpcq973ife.ptx.o
E0916 19:14:38.795000 9120 Lib\site-packages\torch\_inductor\runtime\triton_heuristics.py:539] [0/0_1]
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] WON'T CONVERT forward E:\ComfyUI_NVME\ComfyUI_windows_portable\ComfyUI\comfy\ldm\wan\model.py line 202
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] due to:
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] Traceback (most recent call last):
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_dynamo\convert_frame.py", line 1213, in __call__
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] result = self._inner_convert(
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_dynamo\convert_frame.py", line 598, in __call__
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] return _compile(
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_dynamo\convert_frame.py", line 1059, in _compile
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] guarded_code = compile_inner(code, one_graph, hooks, transform)
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_utils_internal.py", line 97, in wrapper_function
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] return function(*args, **kwargs)
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_dynamo\convert_frame.py", line 761, in compile_inner
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] return _compile_inner(code, one_graph, hooks, transform)
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_dynamo\convert_frame.py", line 797, in _compile_inner
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] out_code = transform_code_object(code, transform)
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_dynamo\bytecode_transformation.py", line 1422, in transform_code_object
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] transformations(instructions, code_options)
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_dynamo\convert_frame.py", line 257, in _fn
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] return fn(*args, **kwargs)
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_dynamo\convert_frame.py", line 715, in transform
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] tracer.run()
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_dynamo\symbolic_convert.py", line 3500, in run
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] super().run()
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_dynamo\symbolic_convert.py", line 1337, in run
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] while self.step():
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_dynamo\symbolic_convert.py", line 1246, in step
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] self.dispatch_table[inst.opcode](self, inst)
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_dynamo\symbolic_convert.py", line 817, in wrapper
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] return handle_graph_break(self, inst, speculation.reason)
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_dynamo\symbolic_convert.py", line 867, in handle_graph_break
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] self.output.compile_subgraph(self, reason=reason)
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_dynamo\output_graph.py", line 1179, in compile_subgraph
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] self.compile_and_call_fx_graph(
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_dynamo\output_graph.py", line 1437, in compile_and_call_fx_graph
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] compiled_fn = self.call_user_compiler(gm)
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_dynamo\output_graph.py", line 1487, in call_user_compiler
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] return self._call_user_compiler(gm)
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_dynamo\output_graph.py", line 1519, in _call_user_compiler
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] compiled_fn = compiler_fn(gm, self.example_inputs())
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_dynamo\repro\after_dynamo.py", line 150, in __call__
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] compiled_gm = compiler_fn(gm, example_inputs)
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\__init__.py", line 2347, in __call__
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] return compile_fx(model_, inputs_, config_patches=self.config)
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_inductor\compile_fx.py", line 2101, in compile_fx
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_inductor\compile_fx.py", line 760, in _compile_fx_inner
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] raise InductorError(e, currentframe()).with_traceback(
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_inductor\compile_fx.py", line 745, in _compile_fx_inner
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] mb_compiled_graph = fx_codegen_and_compile(
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_inductor\compile_fx.py", line 1295, in fx_codegen_and_compile
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] return scheme.codegen_and_compile(gm, example_inputs, inputs_to_check, graph_kwargs)
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_inductor\compile_fx.py", line 1197, in codegen_and_compile
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] compiled_fn = graph.compile_to_module().call
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_inductor\graph.py", line 2083, in compile_to_module
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] return self._compile_to_module()
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_inductor\graph.py", line 2130, in _compile_to_module
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] mod = PyCodeCache.load_by_key_path(
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_inductor\codecache.py", line 2747, in load_by_key_path
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] mod = _reload_python_module(key, path)
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_inductor\runtime\compile_tasks.py", line 36, in _reload_python_module
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] exec(code, mod.__dict__, mod.__dict__)
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "C:\Users\eddie\AppData\Local\Temp\torchinductor_eddie\a2\ca2w5vuweco7jbse7bnnh7pxaprfmid6vjvxyscjxohgzbj4ax5a.py", line 42, in
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] triton_poi_fused_add_0 = async_compile.triton('triton_poi_fused_add_0', '''
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_inductor\async_compile.py", line 346, in triton
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] kernel.precompile(warm_cache_only=False)
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_inductor\runtime\triton_heuristics.py", line 276, in precompile
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] self._precompile_worker()
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_inductor\runtime\triton_heuristics.py", line 296, in _precompile_worker
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] compile_results.append(self._precompile_config(c))
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_inductor\runtime\triton_heuristics.py", line 537, in _precompile_config
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] binary = triton.compile(*compile_args, **compile_kwargs)
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\triton\compiler\compiler.py", line 283, in compile
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] next_module = compile_ir(module, metadata)
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\triton\backends\nvidia\compiler.py", line 407, in
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] stages["cubin"] = lambda src, metadata: self.make_cubin(src, metadata, options, self.capability)
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\triton\backends\nvidia\compiler.py", line 389, in make_cubin
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] raise RuntimeError(f'{error}\n'
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] torch._inductor.exc.InductorError: RuntimeError: `ptxas` failed with error code 4294967295
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] `ptxas` stderr:
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ptxas fatal : Value 'sm_120' is not defined for option 'gpu-name'
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280]
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] Repro command: E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\triton\backends\nvidia\bin\ptxas.exe -lineinfo -v --gpu-name=sm_120 C:\Users\eddie\AppData\Local\Temp\tmpcq973ife.ptx -o C:\Users\eddie\AppData\Local\Temp\tmpcq973ife.ptx.o
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280]
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280]
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo"
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280]
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] Traceback (most recent call last):
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_dynamo\convert_frame.py", line 1213, in __call__
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] result = self._inner_convert(
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_dynamo\convert_frame.py", line 598, in __call__
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] return _compile(
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_dynamo\convert_frame.py", line 1059, in _compile
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] guarded_code = compile_inner(code, one_graph, hooks, transform)
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_utils_internal.py", line 97, in wrapper_function
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] return function(*args, **kwargs)
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_dynamo\convert_frame.py", line 761, in compile_inner
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] return _compile_inner(code, one_graph, hooks, transform)
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_dynamo\convert_frame.py", line 797, in _compile_inner
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] out_code = transform_code_object(code, transform)
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_dynamo\bytecode_transformation.py", line 1422, in transform_code_object
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] transformations(instructions, code_options)
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_dynamo\convert_frame.py", line 257, in _fn
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] return fn(*args, **kwargs)
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_dynamo\convert_frame.py", line 715, in transform
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] tracer.run()
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_dynamo\symbolic_convert.py", line 3500, in run
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] super().run()
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_dynamo\symbolic_convert.py", line 1337, in run
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] while self.step():
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_dynamo\symbolic_convert.py", line 1246, in step
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] self.dispatch_table[inst.opcode](self, inst)
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_dynamo\symbolic_convert.py", line 817, in wrapper
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] return handle_graph_break(self, inst, speculation.reason)
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_dynamo\symbolic_convert.py", line 867, in handle_graph_break
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] self.output.compile_subgraph(self, reason=reason)
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_dynamo\output_graph.py", line 1179, in compile_subgraph
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] self.compile_and_call_fx_graph(
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_dynamo\output_graph.py", line 1437, in compile_and_call_fx_graph
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] compiled_fn = self.call_user_compiler(gm)
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_dynamo\output_graph.py", line 1487, in call_user_compiler
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] return self._call_user_compiler(gm)
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_dynamo\output_graph.py", line 1519, in _call_user_compiler
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] compiled_fn = compiler_fn(gm, self.example_inputs())
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_dynamo\repro\after_dynamo.py", line 150, in __call__
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] compiled_gm = compiler_fn(gm, example_inputs)
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\__init__.py", line 2347, in __call__
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] return compile_fx(model_, inputs_, config_patches=self.config)
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_inductor\compile_fx.py", line 2101, in compile_fx
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_inductor\compile_fx.py", line 760, in _compile_fx_inner
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] raise InductorError(e, currentframe()).with_traceback(
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_inductor\compile_fx.py", line 745, in _compile_fx_inner
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] mb_compiled_graph = fx_codegen_and_compile(
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_inductor\compile_fx.py", line 1295, in fx_codegen_and_compile
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] return scheme.codegen_and_compile(gm, example_inputs, inputs_to_check, graph_kwargs)
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_inductor\compile_fx.py", line 1197, in codegen_and_compile
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] compiled_fn = graph.compile_to_module().call
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_inductor\graph.py", line 2083, in compile_to_module
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] return self._compile_to_module()
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_inductor\graph.py", line 2130, in _compile_to_module
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] mod = PyCodeCache.load_by_key_path(
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_inductor\codecache.py", line 2747, in load_by_key_path
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] mod = _reload_python_module(key, path)
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_inductor\runtime\compile_tasks.py", line 36, in _reload_python_module
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] exec(code, mod.__dict__, mod.__dict__)
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "C:\Users\eddie\AppData\Local\Temp\torchinductor_eddie\a2\ca2w5vuweco7jbse7bnnh7pxaprfmid6vjvxyscjxohgzbj4ax5a.py", line 42, in
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] triton_poi_fused_add_0 = async_compile.triton('triton_poi_fused_add_0', '''
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_inductor\async_compile.py", line 346, in triton
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] kernel.precompile(warm_cache_only=False)
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_inductor\runtime\triton_heuristics.py", line 276, in precompile
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] self._precompile_worker()
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_inductor\runtime\triton_heuristics.py", line 296, in _precompile_worker
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] compile_results.append(self._precompile_config(c))
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_inductor\runtime\triton_heuristics.py", line 537, in _precompile_config
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] binary = triton.compile(*compile_args, **compile_kwargs)
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\triton\compiler\compiler.py", line 283, in compile
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] next_module = compile_ir(module, metadata)
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\triton\backends\nvidia\compiler.py", line 407, in
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] stages["cubin"] = lambda src, metadata: self.make_cubin(src, metadata, options, self.capability)
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] File "E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\triton\backends\nvidia\compiler.py", line 389, in make_cubin
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] raise RuntimeError(f'{error}\n'
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] torch._inductor.exc.InductorError: RuntimeError: `ptxas` failed with error code 4294967295
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] `ptxas` stderr:
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] ptxas fatal : Value 'sm_120' is not defined for option 'gpu-name'
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280]
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] Repro command: E:\ComfyUI_NVME\ComfyUI_windows_portable\python_embeded\Lib\site-packages\triton\backends\nvidia\bin\ptxas.exe -lineinfo -v --gpu-name=sm_120 C:\Users\eddie\AppData\Local\Temp\tmpcq973ife.ptx -o C:\Users\eddie\AppData\Local\Temp\tmpcq973ife.ptx.o
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280]
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280]
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280] Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo"
W0916 19:14:38.825000 9120 Lib\site-packages\torch\_dynamo\convert_frame.py:1280]
'sm_120' is not a recognized processor for this target (ignoring processor)
'sm_120' is not a recognized processor for this target (ignoring processor)
'sm_120' is not a recognized processor for this target (ignoring processor)
'sm_120' is not a recognized processor for this target (ignoring processor)
'sm_120' is not a recognized processor for this target (ignoring processor)
'sm_120' is not a recognized processor for this target (ignoring processor)
'sm_120' is not a recognized processor for this target (ignoring processor)
'sm_120' is not a recognized processor for this target (ignoring processor)
'sm_120' is not a recognized processor for this target (ignoring processor)
'sm_120' is not a recognized processor for this target (ignoring processor)
'sm_120' is not a recognized processor for this target (ignoring processor)
'sm_120' is not a recognized processor for this target (ignoring processor)
LLVM ERROR: Cannot select: intrinsic %llvm.nvvm.shfl.sync.bfly.i32
E:\ComfyUI_NVME\ComfyUI_windows_portable>pause
Press any key to continue . . .
Contributor guide
Assessment
This issue has not been assessed yet.