awslabs / awslabs/graphrag-toolkit

Retrieval requires very large dependencies

Open
#91 2 comments 0 reactions 1 assignee Claimed by @mykola-pereyma View on GitHub
dependencies
Dominant language
Python
Stars
442
Forks
106
Avg merge
2d 17h
Merged PRs (30d)
52

Description

I've attempted to create an MCP server using AWS Lambda with graphrag libraries. I've used the Lambda layers instead of docker containers for lower cold-start times. However the dependencies required for graphrag are extremely large that they cant even fit into AWS Lambda layers and hit limits. **Spacy** alone is 500 MB and **llama-index-core** brings a large amount of dependencies. It would be great to be able to make the retrieval a lot more light-weight for environments like AWS Lambda.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.