awslabs / awslabs/aws-lambda-redshift-loader
Errors 53300, 25P02
- Dominant language
- JavaScript
- Stars
- 595
- Forks
- 161
- PR merge metrics
- No merged PRs in 30d
Description
Most of the time the loader is working, but roughly 1% of the time I’m getting errors like the ones below.
I don’t see anything unusual about the failing files.
Some specifics:
• "version": "2.6.5", "batchSize": 1, "batchSizeBytes": 1000, "batchTimeoutSecs": 10
• File sizes vary from 100B to 1MB and they arrive roughly every 10 minutes
• 13 items in LambdaRedshiftBatchLoadConfig so far, defining the different tables to be loaded.
I'm guessing the "code" in the error message refers to postgress error codes:
25P02 - current transaction is aborted
53300 - too many connections
Thoughts?
> {"error":"{\"redshift-cdr.cc5mfylzdhpr.us-east-1.redshift.amazonaws.com\":{\"status\":-1,\"error\":{\"name\":\"error\",\"length\":157,\"severity\":\"FATAL\",\"code\":\"53300\",\"file\":\"/home/ec2-user/padb/src/pg/src/backend/utils/init/postinit.c\",\"line\":\"587\",\"routine\":\"InitPostgres\"}}}","status":"error","batchId":"9a00c52f-3a3a-412c-8592-705ce6234814","s3Prefix":"usan-insight-ingestion-0011-ctg/BRANDSCS/RedshiftStage/callflow_task.csv","key":"BRANDSCS/RedshiftStage/callflow_task.csv/2018/12/09/callflow_task.csv.CITICARD_DET_18-12-09_00-30_wv3.part_00000","originalManifest":"usan-insight-ingestion-0011-ctg/BRANDSCS/RedshiftLoader/ImportManifests/Manifest.txt/manifest-2018-12-12 01:45:54-317","failedManifest":"usan-insight-ingestion-0011-ctg/BRANDSCS/RedshiftLoader/FailedManifests/manifest-2018-12-12 01:45:54-317"}
>
> {"error":"{\"redshift-cdr.cc5mfylzdhpr.us-east-1.redshift.amazonaws.com\":{\"status\":-1,\"error\":{\"name\":\"error\",\"length\":180,\"severity\":\"ERROR\",\"code\":\"25P02\",\"file\":\"/home/ec2-user/padb/src/pg/src/backend/tcop/postgres.c\",\"line\":\"2145\",\"routine\":\"execOneParseTree\"}}}","status":"error","batchId":"0277fb0d-2e18-441a-8014-120058e52ed5","s3Prefix":"usan-insight-ingestion-0011-ctg/BRANDSCS/RedshiftStage/etl_file.csv","key":"BRANDSCS/RedshiftStage/etl_file.csv/2018/12/10/etl_file.csv.CITICARD_DET_18-12-10_00-00_wv3.part_00000","originalManifest":"usan-insight-ingestion-0011-ctg/BRANDSCS/RedshiftLoader/ImportManifests/Manifest.txt/manifest-2018-12-12 18:06:13-5601","failedManifest":"usan-insight-ingestion-0011-ctg/BRANDSCS/RedshiftLoader/FailedManifests/manifest-2018-12-12 18:06:13-5601"}
>
Cheers,
Jeff
Contributor guide
Assessment
This issue has not been assessed yet.