ahamlabs / ahamlabs/kairos-AI

📝 Phase 2: Transcript Extraction & Vector DB Setup

未關閉
#7 0 則留言 0 個 reaction 已指派 0 人 在 GitHub 檢視
backend rag-pipeline
主要語言
Python
星號
0
分支
1
PR 合併指標
30 天內沒有已合併 PR

描述

## Phase 2: RAG Foundation

Implement automated transcript extraction and vector storage.

### Tasks
- [ ] Implement Transcript Downloader service using yt-dlp
- [ ] Set up Vector DB connection (Redis/Chroma)
- [ ] Create Embedding pipeline (Text → Vector)
- [ ] Design chunking strategy for long transcripts
- [ ] Implement batch processing for multiple videos
- [ ] Add error handling for videos without captions

### Acceptance Criteria
- Automatic transcript extraction for all course videos
- Transcripts chunked optimally (512-1024 tokens)
- Embeddings stored in vector database
- Fallback mechanism for caption-less videos
- Metadata stored alongside vectors (video_id, timestamp)

### Tech Stack
- yt-dlp for captions
- Redis Vector Search / ChromaDB
- sentence-transformers or OpenAI embeddings
- Langchain for chunking

貢獻指南

這個儲存庫沒有索引到貢獻指南

評估

這個 Issue 還沒有評估資料。

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。