Issues Running Model Worker for Gradio Server


(convllava) nofreewill@nofreewill:~/Documentos/convllava/conv-llava$ python llava/serve/model_worker.py
2024-05-27 16:17:58 | INFO | model_worker | args: Namespace(host='localhost', port=21002, worker_address='http://localhost:21002', controller_address='http://localhost:21001', model_path='facebook/opt-350m', model_base=None, model_name=None, device='cuda', multi_modal=False, limit_model_concurrency=5, stream_interval=1, no_register=False, load_8bit=False, load_4bit=False)
2024-05-27 16:17:58 | INFO | model_worker | Loading the model opt-350m on worker 190dfb ...
2024-05-27 16:17:58 | ERROR | stderr | /home/nofreewill/miniconda3/envs/convllava/lib/python3.11/site-packages/huggingface_hub/file_download.py:1132: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2024-05-27 16:17:58 | ERROR | stderr | warnings.warn(
tokenizer_config.json: 0%| | 0.00/685 [00:00

Start with llava/serve/model_worker.py and reproduce the shown `python llava/serve/model_worker.py` command using `facebook/opt-350m`. Compare the configured model type with the reported LlavaLlama initialization and determine what successful worker startup should report without the shown model-loading warnings.

Written by the indexing model from the issue text.