Evolutionary-Algorithms-On-Click / Evolutionary-Algorithms-On-Click/user_docs

refactor: Implement RAG Pipeline for AI Chatbot to Replace Full-Context Injection

Open
#22 3 comments 0 reactions 1 assignee Claimed by @WinterSun23 View on GitHub
amsoc-accepted
Dominant language
JavaScript
Stars
1
Forks
2
PR merge metrics
No merged PRs in 30d

Description

## Overview

The chatbot currently injects the full documentation into the system prompt using `INCLUDE_DOCS_CONTEXT`. This works for testing, but it’s inefficient, slow, and wastes tokens.

## Goal

Replace full-doc injection with a RAG setup to reduce tokens and improve response time.

## Plan

- Parse all `.md` files from `user_docs`
- Split content into logical chunks
- Generate embeddings per chunk
- Store them in a simple local vector index
- On each query:
- Run semantic search
- Fetch top 3–5 relevant chunks
- Inject only those into the prompt

## Acceptance

- `INCLUDE_DOCS_CONTEXT` is removed or rerouted to RAG
- Token usage drops noticeably
- Project-specific answers still work

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.