guardian / guardian/dotcom-rendering
Improve fastly loggings in S3 and athena
Open
- Dominant language
- TypeScript
- Stars
- 274
- Forks
- 34
- Avg merge
- 2d 22h
- Merged PRs (30d)
- 121
Description
In AWS S3 bucket `aws-frontend-logs` under fastly folder, there are some fastly services which are sending the logs in a none-partitioned pattern. This is not idea, because it'll make the athena query slower and harder to find the recods we're looking for.
After partitioning the logs, we will need to also add the partition to the relevant athena tables. Follow the instruction here: https://github.com/guardian/fastly-edge-cache/blob/main/theguardiancom/docs/logging.md#setup-aws-glue
Contributor guide
Assessment
This issue has not been assessed yet.