AllenInstitute / AllenInstitute/ConnectsCommonConnectivity

Cross-dataset reads: union DataItems by shared features/clusters

Open
#23 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

enhancement io
Dominant language
Jupyter Notebook
Stars
4
Forks
1
PR merge metrics
No merged PRs in 30d

Description

Problem: DatasetReader is single-dataset; cohorts sharing feature sets or memberships need N calls + manual concat (etl_v1dd_04_read).

Fix: implement planning/20260623/prompts/_deferred/08_readers.md Layer 2; flagship read_dataitems_for_clusters(cluster_ids, via=("membership","mapping")).

Subtasks: move parquet_loader.pyio/parquet_loader.py (pure move); subset-connectivity filter helper (see #17, #18).

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with planning/20260623/prompts/_deferred/08_readers.md Layer 2 and the existing DatasetReader, then inspect parquet_loader.py and the etl_v1dd_04_read example. Implement read_dataitems_for_clusters with both membership and mapping modes, move parquet_loader.py to io/parquet_loader.py, and review #17 and #18 for the subset-connectivity filter requirements.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
data
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
55/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.