simonsobs / simonsobs/sotodlib

Preprocess super group implementation for dark dets

Open
#1,328 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

preprocess
Dominant language
Python
Stars
19
Forks
23
Avg merge
1d 5h
Merged PRs (30d)
14

Description

We need the ability to run a higher level preprocessing pipeline on specific groups (wafers, bands, etc) before the main pipelines in order to make use of dark detectors for analysis. These are only found in the 90 GHz band so they would not be loaded when preprocessing is divided by wafer and band. This would use the same config file but have its own section which decides on what detectors to load and have a separate list of processes. This could be saved into a different manifest db and h5 file if required, though we don't expect to put any heavy functions in there. It would then be wrapped into aman with different axes and used in the respective functions. Any outputs would not be saved into proc_aman or the main manifest dbs.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

The issue names no files or tests; start by tracing the existing preprocessing pipeline and how aman, proc_aman, and the manifest databases are integrated. Done would mean a separate configurable group-level preprocessing stage for selected detectors, with its own process list and axes, while keeping its outputs out of proc_aman and the main manifests.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
data
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.