google / google/osv.dev

Move GKE temporary directories to ephemeral storage

Open
#1,677 1 comment 0 reactions 0 assignees View on GitHub
backlog infra techdebt worker
Dominant language
Go
Stars
2.9k
Forks
369
Avg merge
1d 17h
Merged PRs (30d)
149

Description

Currently, our worker/importer/exporter use the attached persistent SSDs to store temporary data such as git repositories, which can cause problems if the files are not deleted before the pod exits.

#1666 somewhat addressed this by deleting the tmp folder on startup, but we shouldn't actually be storing these files on the that SSD anyway.

We should add an [ephemeral ssd](https://cloud.google.com/kubernetes-engine/docs/concepts/local-ssd#api) to the worker nodes to use for the working directory & temp files.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.