vllm 0.12.0 will require us to change the use_inductor instructions
Open
enhancement
- Dominant language
- Python
- Stars
- 2k
- Forks
- 561
- Avg merge
- 4d 5h
- Merged PRs (30d)
- 145
Description
```
(VllmAsyncGenerationWorker pid=3351223, ip=10.65.13.209) WARNING 12-17 12:47:06 [compilation.py:699] The 'use_inductor' flag is deprecated and will be removed in the next release (v0.12.0). Please use the 'backend' option instead.
```
FYI @guyueh1 @yuki-97 @yfw
Contributor guide
Assessment
This issue has not been assessed yet.