Evolutionary-Algorithms-On-Click / Evolutionary-Algorithms-On-Click/user_docs

refactor: Implement RAG Pipeline for AI Chatbot to Replace Full-Context Injection

Abierto
#22 3 comentarios 0 reacciones 1 asignado Reclamado por @WinterSun23 Ver en GitHub
amsoc-accepted
Lenguaje dominante
JavaScript
Estrellas
1
Forks
2
Métricas de merge de PR
Sin PR fusionados en 30 d

Descripción

## Overview

The chatbot currently injects the full documentation into the system prompt using `INCLUDE_DOCS_CONTEXT`. This works for testing, but it’s inefficient, slow, and wastes tokens.

## Goal

Replace full-doc injection with a RAG setup to reduce tokens and improve response time.

## Plan

- Parse all `.md` files from `user_docs`
- Split content into logical chunks
- Generate embeddings per chunk
- Store them in a simple local vector index
- On each query:
- Run semantic search
- Fetch top 3–5 relevant chunks
- Inject only those into the prompt

## Acceptance

- `INCLUDE_DOCS_CONTEXT` is removed or rerouted to RAG
- Token usage drops noticeably
- Project-specific answers still work

Guía de contribución

No hay ninguna guía de contribución indexada para este repositorio

Evaluación

Este issue todavía no se ha evaluado.

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.