AllenNeuralDynamics / AllenNeuralDynamics/aind-dynamic-foraging-bfm-dispatcher

Study 09: top-seven plus species-balanced external transfer panel

Đang mở
#134 2 bình luận 0 reaction 1 người được giao Được @hanhou nhận Xem trên GitHub
evaluation extension priority:P1
Ngôn ngữ chính
Python
Star
0
Fork
0
Merge trung bình
2 giờ 9 phút
Pull request đã merge (30 ngày)
31

Mô tả

## Context

The first three Study 09 targets showed promising transfer. Stage A expanded the benchmark only when a complete released cohort fit the existing v1 or v2 split contract. Draft PR: #139.

## Cohort audit

### Admitted

- [x] Lebedeva — mouse, v1
- [x] Beron — mouse, v1
- [x] Kwak — mouse, v1
- [x] Miller — rat, v1
- [x] Findling — human, v1
- [x] Tang — macaque, v1
- [x] Alsiö cohorts II–V — rat, v1
- [x] Eckstein — human, v2
- [x] Costa — macaque, v1
- [x] López-Yépez mouse — mouse, v1

Grossman, Chen, and Zid are reused from the completed first round.

### Skipped without schema v3

- [x] López-Yépez human — mixed 1–4 sessions per subject; complete cohort is neither v1 nor v2.
- [x] Shin — released sessions cannot be mapped back to subject identity.
- [x] Alsiö cohort VI — chronological real-session identity is unavailable.
- [x] Hattori — pinned public behavior derivative is blocked by authorization/WAF responses.
- [x] Samejima — no stable public trial-level choice/reward release located.
- [x] Kubanek — excluded as non-binary.

## Validation and execution

- [x] Pin release identities, terms, checksums, inclusion rules, exact counts, and deterministic manifests.
- [x] Pass canonical binary choice/reward and v1/v2 contract validation.
- [x] Pass local real-subject CPU smoke tests.
- [x] Pass one D=614, seed-0 GRU GPU smoke for all ten admitted expansion cohorts.
- [x] Complete and freeze full GRU D={10,30,100,300,614} × three-seed matrices on Beaker GPU.
- [x] Complete all common-Q fits on Allen HPC CPU.
- [x] Freeze exact ordered GRU/Q trial-key parity and publish Results 2 and 3.
- [ ] Review the Stage-A decision report before selecting any new author model.

Draft PR #139 contains the completed common-Q fits, frozen parity evidence, and reports; those acceptance boxes remain open until the PR is merged.

## Stage-A decision result

At D=614, GRU wins four unadjusted subject-paired comparisons, common Q wins five, and four are unresolved. All 13 cohorts improve in trial-pooled GRU likelihood from D=10 to D=614, but the largest D is not always the curve maximum. The embedding report shows every external cohort farther from the source distribution than held-out AIND mice in every seed.

No CPU-only work was submitted to Beaker. No new split abstraction or author-model family was introduced.

Hướng dẫn đóng góp

Chưa lập chỉ mục được hướng dẫn đóng góp cho kho mã nguồn này

Đánh giá

Issue này chưa được đánh giá.

Nhận issue mới trong hộp thư của bạn

Bản tóm tắt ngắn những issue GitHub phù hợp với người mới.