OptimalScale / OptimalScale/LMFlow
[BUG]使用远程服务器运行chatbot_gradio.py时意外中断连接
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 8.5k
- Forks
- 822
- PR merge metrics
- No merged PRs in 30d
Description
您好,在使用实验室远程服务器(3张3090卡)运行chatbot_gradio.py文件时会发生服务器中断连接情况,直接退出原本正常运行界面,或者是直接卡住,想请问一下这是什么原因呢?是远程服务器无法带动该程序吗?
所运行的具体命令为python ./examples/chatbot_gradio.py --deepspeed configs/ds_config_chatbot.json --model_name_or_path YOUR-LLAMA --lora_model_path ./robin-7b --prompt_structure "A chat between a curious human and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the human's questions.###Human: {input_text}###Assistant:" --end_string "#" --max_new_tokens 200
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with examples/chatbot_gradio.py and configs/ds_config_chatbot.json, then reproduce the reported command while collecting the server and process logs. Check whether the interruption or hang can be tied to the remote server or resource usage; done means identifying a reproducible cause and documenting the required fix or configuration.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, pytorch
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100