DemocracyLab / DemocracyLab/CivicTechExchange

Configure S3 buckets to not be indexable by search engine crawlers

Open
#972 1 comment 0 reactions 0 assignees View on GitHub
Investigation OPERATIONS
Dominant language
JavaScript
Stars
105
Forks
71
PR merge metrics
No merged PRs in 30d

Description

Currently the publicly viewable files we store in S3 for users is being indexed by at least google, and continues to be indexed if the files are removed from S3. We would like to prevent this indexing somehow, as we only want the files accessed via the DemocracyLab platform.

Contributor guide

Open the contributing guide

Research direction

The issue identifies publicly viewable user files in S3 as the scope but names no repository files or tests. Start by locating the S3 bucket configuration and checking how files are exposed; done means crawler indexing is prevented while intended DemocracyLab access still works, including removed-file search results.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws
Domain
cloud, security
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.