Luminous-Dynamics / Luminous-Dynamics/symthaea

Butlin HOT-3: prove metacognitive state causally guides belief updating and action

Open
#2,000 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Rust
Stars
9
Forks
1
Avg merge
15m
Merged PRs (30d)
8

Description

Finding

The current HOT-3 Butlin probe is not construct-specific enough.

Today the live signal resolves HOT-3 from actual_effective_lr > 0, and the ablation uses enable_online_learning=false. That establishes that online learning exists and can be disabled. It does not establish the stronger HOT-3 relation we should require: higher-order/metacognitive state causally guides belief formation or action.

Symthaea already has a promising production path: the cognitive loop's metacognitive layer computes self-model accuracy, and sufficiently high accuracy modulates the subsystem learning-rate factor. That relation should be tested directly.

Objective

Demonstrate:

metacognitive state
      ↓
precision / learning / belief update policy
      ↓
belief or action consequence

while holding first-order task evidence fixed.

Required experiment

Prefer to reuse the typed confidence/self-model intervention infrastructure being developed for HOT-2 (#1910), but keep HOT-3's outcome and evidence classification distinct.

Required arms:

  • calibrated/high-reliability metacognitive state;
  • deliberately degraded or corrupted metacognitive state under identical first-order evidence;
  • metacognition-disabled arm;
  • unrelated sham intervention;
  • rescue restoring trustworthy metacognitive information without overwriting the final belief/action.

Required measurements

  • independent proof of metacognitive intervention;
  • first-order evidence/task input equality across arms;
  • metacognitive accuracy/confidence before policy consequence;
  • actual learning/precision factor selected by the production loop;
  • belief update magnitude and/or action choice;
  • downstream task consequence;
  • exact source/config/stimulus/seed/intervention identity;
  • multi-seed and alternate-task replication.

Fail-closed constraints

  • actual_effective_lr > 0 alone is not HOT-3 evidence.
  • Turning off all online learning is too broad to prove metacognitive guidance.
  • Do not use the same scalar both as intervention verification and outcome.
  • If confidence corruption changes first-order correctness/evidence, the trial is invalid for this theorem.
  • Evidence reused from HOT-2 must be annotated as a shared intervention/dependency rather than counted as an independent replication.
  • A learning-rate change without a belief/action consequence remains mechanistic evidence, not functional support.

Exit condition

A provenance-bound runner shows that changing only Symthaea's higher-order/metacognitive assessment changes how identical first-order evidence is incorporated into beliefs or actions, with sham specificity and rescue.

No consciousness claim is implied.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reading the HOT-2 confidence/self-model intervention infrastructure from issue #1910 and the cognitive loop's metacognitive layer, including the actual_effective_lr and enable_online_learning paths. Define the required arms and provenance-bound measurements before implementing the runner. Done means identical first-order evidence produces a metacognition-specific belief or action consequence with sham, rescue, and multi-seed replication.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
ai, testing-qa
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
42/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.