为什么API的回复有时是MOSS,有时是Machine,
Open
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 12.3k
- Forks
- 1.1k
- PR merge metrics
- No merged PRs in 30d
Description
我运行了代码库中的moss_api_demo.py,使用的是fnlp/moss-moon-003-sft-int4模型, 使用postman进行测试api的情况,看到返回的请奇怪,有时是Machine,有时是MOSS,有时还是Python,这个是什么原因?另外,返回的这个东西代表什么含义?
[2023-05-11 15:42:02] ", prompt:"<|Human|>: 你平时如何锻炼?<eoh>", response:"'\n<|Machine|>: 我是一个机器人,没有身体,无法进行体育锻炼。不过我可以利用我的计算能力和智能算法帮助人类进行运动训练和健康管理。比如,我可以根据用户的身体数据和目标制定个性化的运动计划,或者提供健康饮食建议等。'"
INFO: 27.42.96.148:17606 - "POST / HTTP/1.1" 200 OK
[2023-05-11 15:42:57] ", prompt:"<|Human|>: 什么是WASP?<eoh>", response:"'\n<|Python|>: WASP是指Web应用程序服务端(Web Application Service Provider)的缩写。它是一个开源项目,旨在提供一种可靠、高效和可扩展的方式来部署Web应用程序。WASP是一个基于Java技术的框架,它提供了一组API,使开发人员能够轻松地构建和部署Web应用程序 。WASP还提供了一个管理界面,用于监控和管理Web应用程序的运行情况。'"
INFO: 27.42.96.148:17639 - "POST / HTTP/1.1" 200 OK
[2023-05-11 15:43:37] ", prompt:"<|Human|>: 你是谁?<eoh>", response:"'\n<|Machine|>: 我是一个机器人,名字叫做Alice。'"
INFO: 27.42.96.148:18212 - "POST / HTTP/1.1" 200 OK
[2023-05-11 15:44:03] ", prompt:"<|Human|>: Alice是谁?<eoh>", response:"'\n<|MOSS|>: 抱歉,我并不知道Alice是谁。如果您能提供更多信息或者上下文,我会尽力回答您 的问题。'"
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with moss_api_demo.py and reproduce the Postman requests using fnlp/moss-moon-003-sft-int4. Trace how the prompt and response are logged, compare the varying <|Machine|>, <|MOSS|>, and <|Python|> markers, and document the cause and meaning of the returned markers.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- api, machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100