OptimalScale / OptimalScale/LMFlow

[BUG]使用远程服务器运行chatbot_gradio.py时意外中断连接

Open
#886 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
8.5k
Forks
822
PR merge metrics
No merged PRs in 30d

Description

您好,在使用实验室远程服务器(3张3090卡)运行chatbot_gradio.py文件时会发生服务器中断连接情况,直接退出原本正常运行界面,或者是直接卡住,想请问一下这是什么原因呢?是远程服务器无法带动该程序吗?
所运行的具体命令为python ./examples/chatbot_gradio.py --deepspeed configs/ds_config_chatbot.json --model_name_or_path YOUR-LLAMA --lora_model_path ./robin-7b --prompt_structure "A chat between a curious human and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the human's questions.###Human: {input_text}###Assistant:" --end_string "#" --max_new_tokens 200

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with examples/chatbot_gradio.py and configs/ds_config_chatbot.json, then reproduce the reported command while collecting the server and process logs. Check whether the interruption or hang can be tied to the remote server or resource usage; done means identifying a reproducible cause and documenting the required fix or configuration.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.