ruvnet / ruvnet/RuVector

[PIR][WP6] CI gate: controlled-replacement causal audit (arXiv:2607.26773) required before latent-channel merge

Open
#850 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

phase-2 pir security
Dominant language
Rust
Stars
4.5k
Forks
603
Avg merge
23h 32m
Merged PRs (30d)
59

Description

Epic: #837 · Plan: docs/research/perpetual-intelligence-runtime/03-program-plan.md

Goal

Require every PR touching latentmesh-align-consuming code or the quarantine module (WP7) to pass a controlled-replacement causal audit before merge. A standing CI gate, not a one-time paper reproduction.

Evidence

arXiv:2607.26773 — "Do Latent Channels Actually Communicate? A Causal Audit of Latent Multi-Agent LLM Communication." Grade A.

Date correction: arXiv's submission timestamp is 2026-07-29, not Aug 5 as the founding brief stated. No Aug 5 revision exists. Use the correct date in every citation.

The paper's argument is why this gate exists: end-task performance gains alone do not establish that a receiver actually used task-relevant information passed through the latent (KV-cache) channel. A system can improve for reasons unrelated to the mechanism its authors credit. The paper introduces a controlled-replacement audit — substitute the channel contents, observe whether behavior changes as the causal story predicts — tested on Qwen3-4B/8B over GSM8K, ARC-C, and MATH-500.

This is the evidentiary basis for invariant 3 ("every agent communication is attributable").

Acceptance criteria

  • A controlled-replacement causal audit implemented per the paper's methodology, runnable as a CI job.
  • CI blocks merge on audit failure for any PR touching latentmesh-align-consuming code or the WP7 quarantine module. Advisory-only is not sufficient — a gate nobody must pass is documentation.
  • The audit report is witness-logged.
  • Audits run against benchmark families equivalent to the paper's (GSM8K / ARC-C / MATH-500, or internal tasks of matched character), with the mapping from their benchmarks to ours documented.
  • Pass/fail criterion stated numerically and pre-registered, not decided per-run after seeing results.
  • A known-null control: a channel deliberately carrying no task-relevant information must fail the audit. Without this, the gate cannot be shown to have discriminating power.
  • Nightly re-runs scheduled via Cloud Scheduler against the day's promoted mutations, feeding WP12's daily cycle.

Dependencies

WP5 (#849) — there must be a live channel to audit. Blocks WP7 (#853).

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with docs/research/perpetual-intelligence-runtime/03-program-plan.md, then inspect code consuming latentmesh-align and the WP7 quarantine module. Define the controlled-replacement audit, its numerical pre-registered pass/fail rule, witness logging, benchmark mapping, known-null control, merge-blocking CI job, and Cloud Scheduler nightly rerun; done means every listed acceptance criterion is implemented and documented.

Written by the indexing model from the issue text.

Assessment

Tech stack
google-cloud, rust
Domain
ai, ci-cd, testing
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.