chaoss / chaoss/CollectOSS

`repo_labor` table taking up over half of the available database space

Open
#232 2 comments 0 reactions 0 assignees View on GitHub
database tech debt
Dominant language
Python
Stars
13
Forks
17
Avg merge
6h 59m
Merged PRs (30d)
1

Description

> [!NOTE]
> Migrated from [augurlabs/augur#3736](https://github.com/augurlabs/augur/issues/3736)
> Originally opened by `@MoralCode` on 2026-02-24

---

I notice that the `repo_labor` table in our db is consuming 1.3TB according to dbeaver.

from the disk usage measured by `sudo df -h`, the whole database is 2.3TB.

This table seems to be where the `scc` metrics get written. I can understand why they might be big if this table is tracking the lines of code and other metrics in every file for every change of every tracked repository.

But since we have several tables representing files (pull_request_files, and eventually commit_files #211 ) already, why cant we store this data in a way that has a foreign key referring to existing file entries, deduplicating this table to reduce its space usage as much as possible.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.