hypothesis

H003 Review

H003 Review

  • Hypothesis ID: H003
  • Name: Multi-Model Convergence
  • Current statement: Different model families may converge on similar recovered procedural structure under the same instrument.
  • Research question: Do different providers converge on materially similar procedural outputs?
  • Prior direction and strength: active / moderate
  • Prior kill-condition status: not_tested

Evidence Supporting

  • EXP-003 showed mostly_stable structural backbone across providers and variants. Source: research/evidence-runs/ECR-000003-representation-sensitivity/experiments/EXP-003-isomorphic-procedures/comparison/generated-v3.1/comparison-summary.md
  • All three experiments completed with full primary datasets under Comparator 3.1.0. Source: research/evidence-runs/ECR-000003-representation-sensitivity/pipeline/generated/ecr-000003-comparison-summary.md

Evidence Challenging

  • EXP-001 and EXP-002 both retained mixed structural backbone outcomes. Sources: research/evidence-runs/ECR-000003-representation-sensitivity/experiments/EXP-001-topology-perturbation/comparison/generated-v3.1/exp-001-comparison-summary.md, research/evidence-runs/ECR-000003-representation-sensitivity/experiments/EXP-002-cross-representation-stability/comparison/generated-v3.1/exp-002-comparison-summary.md
  • Provider-specific recognition behavior diverged in EXP-003. Source: research/evidence-runs/ECR-000003-representation-sensitivity/experiments/EXP-003-isomorphic-procedures/comparison/generated-v3.1/comparison-summary.md

Mixed Evidence

  • Convergence appears stronger for backbone than for primitive sequence, transitions, or constraints. Sources: research/evidence-runs/ECR-000003-representation-sensitivity/pipeline/generated/ecr-000003-comparison-summary.md, research/evidence-runs/ECR-000003-representation-sensitivity/comparison/ECR-000003-explainability-summary.md

Provider, Representation, and Domain Effects

  • Provider effects remain substantial enough that convergence cannot be treated as fully provider-independent.
  • Representation changes appear to stress convergence more than the cross-domain variants in EXP-003.
  • Domain shifts preserved some backbone similarity while still changing detail layers.

Relevant Instrument Findings

  • Comparator 3.1.0 is stronger at identifying backbone-level agreement than detail-layer equivalence.
  • Explainability shows that some literal and primitive disagreements disappear at more abstract layers, but not all.

Threats

  • provider-specific response style
  • model version drift
  • recognition leakage
  • absence of a blind human baseline

Alternative Explanations

  • Apparent convergence may reflect shared LLM training priors or schema constraints rather than stable procedural understanding.
  • Some cross-provider similarity may be comparator-driven rather than model-driven.

Kill Condition

  • Current kill condition: agreement falls apart across diversified artifacts or repeatability runs.
  • Status: partially_met

Proposed Direction

slightly_supported

Proposed Evidence Strength

weak

Board Recommendation

retain

Rationale

There is enough cross-provider structure overlap to keep the hypothesis active, but not enough to claim strong or general convergence.

Next Evidence Needed

  • human baseline extraction
  • additional artifact families
  • model-version repeatability

Human Decision

  • Decision:
  • Reviewer:
  • Date: