aws-samples / aws-samples/amazon-textract-idp-cdk-constructs

chore:DynamoDB vs S3 for TextractGenericAsyncSfnTask

Open
#22 0 comments 0 reactions 0 assignees View on GitHub
chore
Dominant language
TypeScript
Stars
33
Forks
14
PR merge metrics
No merged PRs in 30d

Description

Currently, the DynamoDB table used in TextractGenericSyncSfnTask is only used for the StepFunction Token hand off between the two Async Processing Lambdas and logging into CW. We can use a rather frugal way for this by using a temp file under a prefix something like processing_temp/, where we create a JSON file with naming convention {job_tag}.json with the same fields as the DDB table, and simply read that file to get the necessary info in subsequent processing. If we want to do it in a DB/Query way, we can use S3 Select to query the prefix and filter in where clause by job_tag but this adds un-necessary complexities especially since we can simply get the file by job_tag value and read it as a JSON object/dict.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.