apache / apache/tvm

[Bug] [Relax VM] All of Arguments of SetInput will be Convert to The 1st Device

Open
#17,884 3 comments 0 reactions 0 assignees View on GitHub
needs-triage type: bug
Dominant language
Python
Stars
13.7k
Forks
4k
Avg merge
2d 19h
Merged PRs (30d)
111

Description

https://github.com/apache/tvm/blob/299ef81f0f7e4bae93826141815dfc97c0ea0a42/src/runtime/relax_vm/vm.cc#L510-L531
https://github.com/apache/tvm/blob/299ef81f0f7e4bae93826141815dfc97c0ea0a42/src/runtime/relax_vm/vm.cc#L524

Why all of the arguments given to "SetInput" will be convert to the 1st device? Is it a typo?

I think it should be something below.

func_args[i] = ConvertArgToDevice(args[i], devices[**`i`**], allocators[**`i`**]);

Contributor guide

No contributing guide indexed for this repository

Research direction

Start in src/runtime/relax_vm/vm.cc at lines 510-531, especially the SetInput handling near line 524. Inspect how each argument is converted and verify that the corresponding device and allocator are used; the issue is done when arguments are no longer all converted for the first device.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
compilers
Issue type
Bug
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Stale
Clarity
Clearly specified
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.