labring / labring/FastGPT

Feature: Retrieval Trace View for RAG Debugging

Open
#7,113 1 comment 1 reaction 0 assignees View on GitHub
feature
Dominant language
TypeScript
Stars
29.6k
Forks
7.3k
Avg merge
1d 7h
Merged PRs (30d)
152

Description

### Is your feature request related to a problem? Please describe.

When a workflow returns an incorrect or incomplete answer, it can be difficult to determine where the failure occurred.

For knowledge-base applications, users often need visibility into:

* Which chunks were retrieved
* Which chunks were selected after reranking
* Which sources were ultimately provided to the model

Without this information, debugging retrieval quality becomes largely trial-and-error.

### Describe the solution you'd like

Add an optional "Retrieval Trace" view for workflow executions.

For each query, display:

* Retrieved chunks
* Retrieval scores
* Reranked results
* Final context sent to the LLM
* Source attribution

This could be available in execution logs or a dedicated debugging panel.

### Describe alternatives you've considered

External observability tools can provide partial visibility, but they often lack workflow-specific retrieval information and require additional setup.

### Additional context

This feature would make it significantly easier to debug chunking strategies, retrieval quality, reranking performance, and knowledge-base coverage issues.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.