awslabs / awslabs/data-solutions-framework-on-aws
Feat: provide constructs to simplify genAI patterns implementation
- Dominant language
- TypeScript
- Stars
- 147
- Forks
- 31
- PR merge metrics
- No merged PRs in 30d
Description
The most common patterns for GenAI applications are RAG and LLM fine-tuning/training. DSF can bring some GenAI constructs to accelerate the implementation of these patterns. In details we have identified 3 constructs that could help:
* The RAG pipeline to ingest data into vector databases and provide semantic context to GenAI applications
* The Data API pipeline to expose data to GenAI application and provide situational context to GenAI applications
* The data preparation pipeline to prepare data for model training or fine-tuning
Contributor guide
Research direction
The issue names no files, tests, or entry points. Begin by surveying existing DSF constructs and defining acceptance criteria for the RAG, Data API, and data preparation pipelines; the work is done when those three constructs have an agreed design and implementation scope.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- aws, machine-learning, typescript
- Domain
- ai, api, data-engineering, databases
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 18/100