modelscope / modelscope/sirchmunk

Is there an option to only return the retrieved text without the llm participating in the response?

Open
#132 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
1.3k
Forks
146
Avg merge
3h 31m
Merged PRs (30d)
6

Description

Is there an option to only return the retrieved text without the llm participating in the response?
This seems very important, otherwise we have to wait for the LLM to generate for a long time every time we retrieve. It should be more straightforward.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

The issue names no files, tests, or entry points. Start by locating the retrieval path and the code that invokes the LLM response, then inspect whether an existing option can bypass generation. Done means callers can request the retrieved text alone without waiting for an LLM-generated response.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
ai, search
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
38/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.