OpenBMB / OpenBMB/MiniCPM-o-Demo
如何把全双工模型结合上RAG？
Open
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 386
- Forks
- 81
- Avg merge
- 1h 59m
- Merged PRs (30d)
- 3
Description
如何把全双工模型结合上RAG？比如用户语音提问后，模型判断应该先到私有知识库去检索，检索到的文档片段如何输入到模型中？让模型在decoder的时候能够利用上这些文档内容，回答会更准确。
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
No files, tests, or entry points are named. Start by locating the full-duplex model inference and decoder flow in the repository, then determine how a private knowledge-base retrieval step could provide document context; done would require an agreed integration design and a demonstrated end-to-end retrieval-assisted response.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, pytorch
- Domain
- ai, machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100