AKD Labs preprint

Open
#483 0 comments 0 reactions 1 assignee View on GitHub

@NISH1001 is already working on this.

Since Jun 29, 2026.

Assessment

This issue has not been assessed yet.

Description

Preprint: AKD Labs
Paper repo: NASA-IMPACT/akd-labs-paper"Latex files for AKD labs paper"
Parent EPIC: #474 — Preprint Papers
Tracking: Milestone 26.4 Paper and Workshop
Owner: @NISH1001
Deadline: Tentative — mid-July 2026 (no hard deadline set).

Track the AKD Labs preprint — the agent benchmarking/evaluation platform — from draft to submission-ready. Tick the checklist as items land; link evidence (PRs, figures, eval runs, draft sections) inline.


📋 Paper Readiness Checklist

Literature & positioning
  • Literature review complete — related work surveyed, gaps identified, key prior art cited
  • Contribution / novelty stated explicitly relative to prior work
Agent architecture & methodology
  • Architecture diagram(s) for the agent(s) / platform included — components, tools, data flow, control loop
  • Methodology described in enough detail to reproduce
  • Design decisions and trade-offs justified
Benchmarking & evaluation
  • Benchmark dataset(s) defined, sourced, and documented
  • Evaluation is rigorous — clear metrics, baselines / comparisons, ablations where relevant
  • Results reproducible — code, configs, and data referenced (link akd-evals or the eval harness used)
  • Quantitative results reported with appropriate rigor — multiple runs / error bars / significance where applicable
Science narrative & impact
  • Science use-case narrative written — which scientific workflow this accelerates and for whom
  • Impact articulated — value to NASA science / the target research community
Limitations & responsible AI
  • Limitations section written — honest scope, known failure modes, where it breaks down
  • Responsible-AI / ethical considerations addressed (where applicable)
Manuscript & submission
  • All sections drafted — abstract, intro, methods, results, discussion, conclusion
  • Figures and tables finalized
  • References complete and consistently formatted
  • Internal review / proofread complete
  • Target venue / preprint server chosen (e.g. arXiv) and author list + contributions agreed
Dominant language
Jupyter Notebook
Stars
4
Forks
0
PR merge metrics
No merged PRs in 30d

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from NASA-IMPACT/akd-core

All issues in NASA-IMPACT/akd-core

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.