kiwix / kiwix/operations

Setup k8s garbage collection on all nodes

Open
#285 0 comments 0 reactions 2 assignees Claimed by @rgaudin View on GitHub
enhancement
Dominant language
Python
Stars
15
Forks
5
PR merge metrics
No merged PRs in 30d

Description

Since we keep deploying new images, cluster nodes keep pilling up Docker images / layers on its filesystem.

This is not automatically deleted since it is hard to know for the kubelet when an image is not needed anymore and when it might be needed again few moments later.

In https://github.com/kiwix/operations/issues/163#issuecomment-1914807806, we've setup necessary configuration to cleanup `services` node automatically: if configuration works as expected, when disk usage goes above 80%, k8s will clean unused image until disk usage goes below 50%.

`services` node is now getting close to the point where it will use again more than 80% of its disk, so we are close to being able to confirm things work as expected.

Once done, we need to deploy this configuration on all k8s cluster nodes, and add it to the k8s nodes deployment procedure.

Tasks:
- [x] confirm that settings are working as expected on `services` node
- [ ] deploy settings on all k8s nodes
- [ ] document the settings for new k8s nodes in the wiki

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.