awslabs / awslabs/data-solutions-framework-on-aws

Feat: provide constructs to simplify genAI patterns implementation

Open
#534 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
TypeScript
Stars
147
Forks
31
PR merge metrics
No merged PRs in 30d

Description

The most common patterns for GenAI applications are RAG and LLM fine-tuning/training. DSF can bring some GenAI constructs to accelerate the implementation of these patterns. In details we have identified 3 constructs that could help:

* The RAG pipeline to ingest data into vector databases and provide semantic context to GenAI applications
* The Data API pipeline to expose data to GenAI application and provide situational context to GenAI applications
* The data preparation pipeline to prepare data for model training or fine-tuning

Contributor guide

Open the contributing guide

Research direction

The issue names no files, tests, or entry points. Begin by surveying existing DSF constructs and defining acceptance criteria for the RAG, Data API, and data preparation pipelines; the work is done when those three constructs have an agreed design and implementation scope.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, machine-learning, typescript
Domain
ai, api, data-engineering, databases
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
18/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.