NVIDIA-BioNeMo / NVIDIA-BioNeMo/bionemo-agent-toolkit

Feature request: expose reproducibility metadata and full interface confidence for structure NIMs

Open
#33 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
462
Forks
70
PR merge metrics
No merged PRs in 30d

Description

Hi BioNeMo team,

For reproducible protein-complex research, could the OpenFold3 and Boltz-2 NIM skills/API documentation make the effective model configuration and complete confidence outputs more transparent? The current skills document useful request controls (for example, diffusion samples and Boltz-2 recycling/sampling steps), but I could not find a documented explicit random seed, immutable model/checkpoint identifier, or a guaranteed full PAE/inter-chain PAE and chain-pair interface-confidence response contract. If these already exist, pointers to the exact fields would be very helpful.

A useful research-oriented request/response contract would include:

  • An explicit seed or documented sampling behavior, with seed/sample IDs returned for each structure.
  • The effective parameters and defaults actually used, not just the submitted fields.
  • A model/checkpoint revision or digest and container/image digest, with hosted/local version parity documented.
  • Per-residue pLDDT, full PAE (especially inter-chain PAE), pTM, ipTM/chain-pair interface scores where supported, and a clear description of any score that is not available for a given model.
  • A machine-readable run manifest/example that preserves request, response, MSA/template provenance, and all samples.

Would you consider documenting these fields or exposing them where the NIM API does not yet provide them? That would make self-hosted NIMs much easier to use in auditable scientific studies, where interface scores must be compared across seeds, controls, and construct boundaries. This is a general feature request; no private sequences or experimental data are included.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by locating the OpenFold3 and Boltz-2 NIM skills/API documentation and compare the documented request controls with the requested reproducibility and confidence fields. Done means the documentation or API clearly defines effective parameters, seed and model/container identity, confidence outputs, unavailable scores, and a machine-readable run manifest with provenance.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
api, documentation, machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
42/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.