simonsobs / simonsobs/socs

rename_fields casts all data as doubles

Open
#162 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

bug
Dominant language
Python
Stars
17
Forks
20
Avg merge
1h 22m
Merged PRs (30d)
2

Description

This is relatively low priority, since we rarely if ever need the rename_fields script anymore, but it currently will cast everything as a double. This may cause fields that are re-uploaded to InfluxDB to generate type conflicts with recent data, depending on if new or old data is published first.

https://github.com/simonsobs/socs/blob/12d7bc43edec6d5cc33c0d230257c4a8dd8f24ad/bin/rename_fields#L256

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start in bin/rename_fields around line 256 and trace how values are prepared before being re-uploaded to InfluxDB. Check the existing script behavior and ensure it no longer casts all fields as doubles, with completion shown by avoiding the described type conflicts for re-uploaded data.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
databases
Issue type
Bug
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.