[Question]: failed to run the benchmark with error

Describe the issue

please see below error

(MInference) root@salab-hpedl380g11-03:~/wayne/kvcache/MInference/scbench# VLLM_ALLOW_LONG_MAX_MODEL_LEN=1 CUDA_VISIBLE_DEVICES=0 VLLM_WORKER_MULTIPROC_METHOD=spawn bash scripts/run_all_tasks.sh meta-llama/Llama-3.1-8B-Instruct 1 multi-turn
attn_type: vllm, kv_type: dense
scbench_kv
Traceback (most recent call last):
  File "/root/wayne/kvcache/MInference/scbench/run_scbench.py", line 13, in <module>
    from args import parse_args
  File "/root/wayne/kvcache/MInference/scbench/args.py", line 9, in <module>
    from minference import MInferenceConfig
  File "/root/wayne/kvcache/MInference/lib/python3.12/site-packages/minference/__init__.py", line 8, in <module>
    from .models_patch import MInference
  File "/root/wayne/kvcache/MInference/lib/python3.12/site-packages/minference/models_patch.py", line 7, in <module>
    from .patch import minference_patch, minference_patch_vllm, patch_hf
  File "/root/wayne/kvcache/MInference/lib/python3.12/site-packages/minference/patch.py", line 613, in <module>
    ) -> Union[Tuple, BaseModelOutputWithPast]:
                      ^^^^^^^^^^^^^^^^^^^^^^^
NameError: name 'BaseModelOutputWithPast' is not defined
scbench_prefix_suffix
Traceback (most recent call last):
  File "/root/wayne/kvcache/MInference/scbench/run_scbench.py", line 13, in <module>
    from args import parse_args
  File "/root/wayne/kvcache/MInference/scbench/args.py", line 9, in <module>
    from minference import MInferenceConfig
  File "/root/wayne/kvcache/MInference/lib/python3.12/site-packages/minference/__init__.py", line 8, in <module>
    from .models_patch import MInference
  File "/root/wayne/kvcache/MInference/lib/python3.12/site-packages/minference/models_patch.py", line 7, in <module>
    from .patch import minference_patch, minference_patch_vllm, patch_hf
  File "/root/wayne/kvcache/MInference/lib/python3.12/site-packages/minference/patch.py", line 613, in <module>
    ) -> Union[Tuple, BaseModelOutputWithPast]:
                      ^^^^^^^^^^^^^^^^^^^^^^^