Evolutionary-Algorithms-On-Click / Evolutionary-Algorithms-On-Click/user_docs

refactor: Implement RAG Pipeline for AI Chatbot to Replace Full-Context Injection

Aperta
#22 3 commenti 0 reazioni 1 assegnatario Rivendicata da @WinterSun23 Vedi su GitHub
amsoc-accepted
Lingua principale
JavaScript
Stelle
1
Fork
2
Metriche di merge delle PR
Nessuna PR unita negli ultimi 30g

Descrizione

## Overview

The chatbot currently injects the full documentation into the system prompt using `INCLUDE_DOCS_CONTEXT`. This works for testing, but it’s inefficient, slow, and wastes tokens.

## Goal

Replace full-doc injection with a RAG setup to reduce tokens and improve response time.

## Plan

- Parse all `.md` files from `user_docs`
- Split content into logical chunks
- Generate embeddings per chunk
- Store them in a simple local vector index
- On each query:
- Run semantic search
- Fetch top 3–5 relevant chunks
- Inject only those into the prompt

## Acceptance

- `INCLUDE_DOCS_CONTEXT` is removed or rerouted to RAG
- Token usage drops noticeably
- Project-specific answers still work

Guida per i contributori

Nessuna guida per i contributori indicizzata per questo repository

Valutazione

Questa issue non è ancora stata valutata.

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.