aws-samples / aws-samples/Serverless-Retrieval-Augmented-Generation-RAG-on-AWS
Load Test: concurrent usage
Open
helpmebuild
load-test
low-prio
- Dominant language
- JavaScript
- Stars
- 93
- Forks
- 31
- PR merge metrics
- No merged PRs in 30d
Description
right now we have limited the execution of the ingestion function to 1. [LanceDB has a native lock system based on DynamoDB locks](https://lancedb.github.io/lance/read_and_write.html#concurrent-writer-on-s3-using-dynamodb) currently in beta. We should experiment with this and remove the artificial limitation of 1 max concurrent execution for the writer.
Once this is implemented, we should run load tests to understand impact on retrieval performance against the same (user+knowledge-base).
Contributor guide
Assessment
This issue has not been assessed yet.