guardian / guardian/dotcom-rendering

Improve fastly loggings in S3 and athena

Open
#13,989 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
TypeScript
Stars
274
Forks
34
Avg merge
2d 22h
Merged PRs (30d)
121

Description

In AWS S3 bucket `aws-frontend-logs` under fastly folder, there are some fastly services which are sending the logs in a none-partitioned pattern. This is not idea, because it'll make the athena query slower and harder to find the recods we're looking for.

After partitioning the logs, we will need to also add the partition to the relevant athena tables. Follow the instruction here: https://github.com/guardian/fastly-edge-cache/blob/main/theguardiancom/docs/logging.md#setup-aws-glue

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.