bigbio / bigbio/proteomics-sample-metadata

Think about switching from duplicating columns to list columns

Open
#789 6 comments 1 reaction 0 assignees View on GitHub
Dominant language
HTML
Stars
116
Forks
116
PR merge metrics
No merged PRs in 30d

Description

Working with duplicated columns like "modification parameters" for multiple modifications is not great.
When loading with pandas for example you will receive renamed columns like "modification parameters.1" and then need to do a prefix matching to apply validation rules.

Having a list column would also make the transition to parquet or json or anything more structured easier.

Contributor guide

No contributing guide indexed for this repository

Research direction

No files, tests, or entry points are named. Start by examining how duplicated modification-parameter columns are represented and loaded with pandas, then evaluate the proposed list-column direction alongside parquet and JSON; done requires an agreed schema change and migration scope.

Written by the indexing model from the issue text.

Assessment

Tech stack
pandas
Domain
data-engineering
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.