simonsobs / simonsobs/sotodlib

Config Files with Time Dependence

Open
#322 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

enhancement site-pipeline
Dominant language
Python
Stars
19
Forks
23
Avg merge
1d 5h
Merged PRs (30d)
14

Description

Recording this convo off slack because I'm not sure if I'm getting to it soon (open for others to take).

We've already hit one point in the automated data packaging where it would be nice to be able to have a configuration file where a number could be set for one range of time and then changed for another range of time. This is based off hardware changes during "operations" at UCSD. I expect we'll see more of these when we get onsite.

It's probably possible to build off this lookup_conditional function to build a short way of saving / loading time dependent from a config file. Having a standard easy way to do this would be nice.

(Somewhat related, it seems like ManifestDbs were almost built for this sort of thing by I'm not quite sure how it would work in this sort of instance. More thought there could also be an option. )

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reading the documented lookup_conditional function in sotodlib.site_pipeline.util and review how ManifestDbs might apply to automated data packaging. Define the expected configuration format and time-range behavior before choosing an approach. Done means a standard way to save and load time-dependent configuration values is agreed and implemented.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
data-engineering
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.