simonsobs / simonsobs/socs

Suprsync needs to smartly delete certain smurf files

Open
#866 4 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

enhancement
Dominant language
Python
Stars
17
Forks
20
Avg merge
1h 22m
Merged PRs (30d)
2

Description

We have the timestream suprsyncs set to delete files after a certain amount of time but not the smurf ones. This is because we don't want to delete tune files or the last bg maps, bias steps, etc. This means that the smurf servers slowly get full off of these sorts of files and, for the LAT, this is happening faster than we'd like.

We should upgrade the suprsync delete logic so that we can delete older smurf files that we know we won't need.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by locating the suprsync delete logic in the repository and identify how timestream files are currently handled. Clarify which older smurf files are safe to remove while preserving tune files and the last background maps, bias steps, and other required files. Done means the deletion behavior safely reduces smurf-server storage without removing protected files.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
devops
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.