research-document
Non-Human Experimental Inventory
Non-Human Experimental Inventory
Status: Research analysis artifact — proposal-only, not a canonical accepted record.
Author: Claude (autonomous research-director pass), Cowork session, 2026-07-30.
Repository baseline: commit 1012c0f on branch as checked out at analysis time.
Scope: All located experiments, evidence runs, and evaluation packages whose subject is non-human (AI models, prompts, comparator software, repository artifacts). No human-subject experiments were located or are proposed anywhere in this document.
How to read this document
This is a reconstruction, not a re-statement of each experiment's own README. Fields marked MISSING were not found in the reviewed artifacts and are not assumed to be zero, absent, or negative — only unrecorded. This inventory does not cover 100% of repository files (see Coverage and Known Gaps at the end). It covers the canonical experiment registry (research/framework-engineering/experiments/registry.json), the six research/experiments/ packages, the three research/evidence-runs/ (ECR) packages, the research/framework-engineering/experiments/EX-FE-000{1,2,3} next-generation experiments, and the two major evaluation packages (FE-EVAL-2026-07-23, FE-BOUNDARY-2026-07-28) that themselves function as non-human meta-evaluations.
Two registries already exist in the repository and were treated as ground truth wherever they overlapped with this inventory rather than re-derived from scratch:
research/framework-engineering/experiments/registry.json(machine-readable, generated 2026-07-24T17:38:48Z,EX-*IDs) — the canonical successor experiment registry.research/operating-system/hypothesis-registry.md(H001–H018) — the canonical hypothesis registry.research/evaluations/FE-EVAL-2026-07-23/framework-engineering-executive-brief.md— a prior, independent, adversarial repository-wide evaluation (authored by a different agent, "Codex"). This document is evidence, not settled fact, and is treated as such throughout this analysis.
E1 — FE-011A LLM Blind Pilot
- Experiment ID:
EX-LEGACY-FE-011A(registry) /FE-011A(native) - Title: LLM Blind Pilot — structured redesign vs. original framework
- Research question: Do Framework Engineering redesigns improve quality, consistency, evidence use, traceability, and actionability of blinded LLM outputs, relative to the original (un-redesigned) framework packet?
- Hypothesis: Structured FE redesign improves task output quality (informal; not in H001–H018 registry — tracked as native hypothesis
FE-011A) - Subject/system tested: SWOT, Five Whys, OODA Loop framework packets, original vs. FE-redesigned, worked by an LLM
- Experiment type: Same-model comparative pilot (LLM as both subject and — per the repo's own methodology-review — likely evaluator lineage)
- Date conducted: 2026-06-28 (internal pilot)
- Executing agent / model: MISSING exact model identity and version in reviewed files; registry logs runs as
historical-manual: 8,reviewer: 3 - Provider: MISSING (not disambiguated by provider in available summary)
- Comparison condition / baseline: Original (un-redesigned) framework packet vs. FE-redesigned packet, same scenario
- Independent variables: Redesign condition (original vs. FE-redesigned)
- Dependent variables: Quality, consistency, evidence use, traceability, actionability (qualitative evaluator judgment, not a validated numeric scale)
- Controlled variables: MISSING — no documented control for evaluator identity/model relative to generator identity/model
- Sample size / trials: 3 frameworks × 2 outputs each = 6 output artifacts, each with an evaluator review
- Evaluation method: Evaluator review documents (
evaluator-review.mdper framework), qualitative - Result (as reported): SWOT — Output 1 (redesigned) stronger; Five Whys — Output 2 stronger; OODA — Output 2 stronger; cross-framework pattern of higher traceability/evidence use at the cost of verbosity and process overhead
- Claimed conclusion: "Directional evidence that structured redesigns can improve traceability and evaluation readiness"
- Supported conclusion (this review): Directional and observational only. The pilot does not separate an FE-specific effect from a generic "more structure improves legibility" effect — the pilot's own
methodology-review.md-referenced concern, restated in its own summary. - Confidence claim (native): Not explicitly labeled; treated by
research/theory/confidence-assessment.mdas supporting "Structured redesign improves traceability" at Low confidence. - Limitations (native, self-reported): Same-model evaluation bias risk; generic-scaffolding confound; pilot precedes any human validation
- Linked evidence/hypotheses: Feeds
research/theory/confidence-assessment.md; referenced as input toFE-EVAL-2026-07-23's incremental-utility framing - Supersession status: Current / not superseded; explicitly flagged by
research/theory/research-program-status.mdas needing "different-model replication" - Raw data availability: Present (
results/*/output-1.md,output-2.md,evaluator-review.md,run-log.md) - Reproducibility status: Not independently reproduced; single internal run
E2 — FE-012A Blind Primitive Reasoning Extraction
- Experiment ID:
EX-LEGACY-FE-012A - Research question: Can a finite set of primitive reasoning operations reconstruct the reasoning flow of diverse knowledge artifacts without domain terminology?
- Subject: 20 non-EDF, non-Clarity knowledge artifacts (framework/methodology corpus)
- Type: Same-model, single-extractor, single-reconstructor internal run
- Date: 2026-06-28
- Executing agent: Single extractor pass
EX-01, single reconstruction-analyst passRA-01, same model family for both roles (per own summary) - Baseline/comparison: None (no comparator condition; single-arm extraction-then-reconstruction design)
- Sample: 20 artifacts, 1 pass each
- Result: Reconstruction — Strong 9, Moderate 8, Weak 3, Failed 0; recognizable 17/20; 2 candidate primitives surfaced (
Prioritize,Compare); vocabulary growth "slowed materially" after the artifact-set midpoint - Claimed conclusion: "Provisional support for a finite primitive vocabulary with transfer across multiple domains"
- Supported conclusion (this review): Weak provisional support at best. Same extractor and reconstructor, same model family, prior awareness of the research goal, and subjective recognizability judgment together mean the "0 failures" and "17/20 recognizable" figures cannot distinguish a real transferable vocabulary from extractor-side pattern completion toward a vocabulary the extractor was primed to look for.
- Confidence claim (native, in
confidence-assessment.md): Low — "partial stabilization and recognizable reconstruction, but independent extractor convergence has not yet been demonstrated" - Limitations (self-reported): Same-model internal run, not independent/blinded; recognizability judged subjectively
- Raw data:
results/extraction-results-2026-06-28.csv,reconstruction-results-2026-06-28.csv,stabilization-table-2026-06-28.csv,primitive-vocabulary-v0.1.csv - Reproducibility: Not independently reproduced
E3 — FE-012B Primitive Grammar Synthesis Experiment
- Experiment ID:
EX-LEGACY-FE-012B - Research question: Can the FE-012A primitive vocabulary synthesize coherent procedural reasoning frameworks for novel (unseen) problems?
- Subject: 10 novelty problems, no existing framework may be copied
- Type: Same-model synthesis + same-model review (internal run)
- Date: 2026-06-28
- Result: 10/10 problems attempted; 7/10 completed without a new primitive; 3/10 flagged missing-primitive pressure; 0 outright failures; "Primitive Sufficiency Index" = 70% (native, explicitly flagged by its own authors as "experimental and should not be treated as validated"); missing-primitive requests:
Synchronize,Schedule,Sequence, concentrated in coordination/phased-maintenance problems - Claimed conclusion: Vocabulary "appears expressive enough" generically, weaker for temporal-coordination problems
- Supported conclusion (this review): The 70% figure is a same-model, same-designer, non-independently-reviewed proportion over a 10-item, researcher-authored problem set. It should not be read as an expressive-sufficiency rate in any general sense — at n=10 with no independent review, the confidence interval on "70%" is wide enough to be compatible with anywhere from roughly 35% to 93% true sufficiency under a naive binomial estimate, before even accounting for non-independence of design and evaluation.
- Confidence claim (native): Low
- Limitations (self-reported): same-model synthesis and review; novelty problems designed by the same research direction evaluating the result; no independent reviewer agreement measured
- Raw data:
results/synthesis-run-2026-06-28.md,reviewer-run-2026-06-28.md - Reproducibility: Not independently reproduced
E4 — FE-012C Manual Multi-Model Replication
- Experiment ID:
EX-LEGACY-FE-012C-MANUAL - Research question: Do GPT, Claude, and Gemini converge on primitive-grammar extraction when given the same packet instrument and a provided primitive vocabulary?
- Subject: 15 packets × 3 providers (GPT, Claude, Gemini) = 45 manually collected JSON responses
- Type: Cross-model (single point in time) convergence study, human-operated, no API
- Date: Prior to 2026-07 (exact date MISSING in reviewed files; precedes the repeatability run)
- Providers: GPT (unspecified version — MISSING), Claude (unspecified version — MISSING), Gemini (unspecified version — MISSING)
- Independent variable: Provider
- Dependent variables: Entry primitive, exit primitive, dominant primitive, reasoning shape, transition structure, artifact recognition, candidate missing primitives
- Sample: 45/45 valid JSON responses, 0 missing, 0 malformed
- Result: Entry-primitive full agreement 15/15; exit-primitive full agreement 11/15; dominant-primitive full agreement 12/15; reasoning-shape full agreement 9/15; strong transition agreement 14/15; artifact recognized in 15/15 packets (blinding did not hold); 0/15 packets produced a candidate missing primitive (vocabulary was provided in advance, so this is not independent evidence of sufficiency)
- Claimed conclusion: Strong cross-model agreement "strengthens confidence in the extraction instrument"
- Supported conclusion (this review): Convergence is real at the level measured, but confounded by two mechanisms the experiment's own interpretation.md already names: (1) universal artifact recognition (15/15) means agreement may reflect shared training-data familiarity with named frameworks rather than independent structural extraction from blinded text; (2) the provided vocabulary constrains the space of possible answers, mechanically inflating agreement on which of a small fixed set of primitives applies. See Contradiction C1 in the companion contradiction registry regarding this experiment's relationship to E5.
- Confidence claim (native): Not separately labeled; feeds H003, H013, H015 in the hypothesis registry at Moderate/Moderate/Moderate
- Limitations (self-reported, native): "Model agreement does not prove the theory," "disagreement is useful evidence," blinding weakened by recognition
- Raw data:
responses/{gpt,claude,gemini}/*.json(45 files),reports/FE-012C-*.md - Reproducibility status: Directly re-tested by E5 (repeatability run) — see below. This is the one experiment in the corpus with an explicit, dedicated repeatability follow-up.
E5 — FE-012C Repeatability Run 001
- Experiment ID:
EX-LEGACY-FE-012C-REPEAT-001 - Research question: Does the same packet instrument, run again in fresh conversations with the same three providers, produce materially similar results over time?
- Type: Same-instrument, same-providers, different point in time (temporal repeatability test), explicitly not a new theory experiment per its own README
- Sample: 45 new responses (15 packets × 3 providers), paired against the original 45 from E4 → 45 paired comparisons, 90 total observations
- Result (literal/syntactic comparator): Stable 1/45 (2.2%); elaboration drift 8/45 (17.8%); structural drift 36/45 (80.0%); backbone-stable pairs 9/45 (20.0%); recognized-artifact changed in 41/45 pairs
- Result (semantic comparator, generous re-scoring layered on top, not a replacement): Stable 6/45 (13.3%); structural drift 38/45 (84.4%) — semantic normalization recovers some elaboration-drift cases into "stable" but does not reduce structural drift; if anything the semantic count of structural drift is nominally higher than the literal count
- Claimed conclusion (native, in the dataset-comparison report itself): "This is a measurement analysis task, not a validation of theory... drift does not by itself falsify the instrument"
- Supported conclusion (this review): This is the single most consequential quantitative result in the corpus and it is currently under-weighted in the hypothesis registry. Under both the literal and the semantic comparator, the large majority of same-provider, same-packet, fresh-conversation pairs show structural (not just wording) drift. This directly bears on H004 (Repeatability), whose kill condition reads: "Same-model outputs drift materially across repeated runs without explainable packet ambiguity." An 80% structural-drift rate is a plausible candidate for "drift materially" — see the confidence reassessment and contradiction registry for the full argument on whether this meets or falls short of the kill condition.
- Confidence claim (native, hypothesis registry, current): H004 = Low-Moderate, status Active (i.e., not yet downgraded to reflect this dataset)
- Limitations (self-reported): 15/45 Dataset-B files required quote normalization before parsing (data-quality, not reasoning, issue); repeatability conclusions remain sensitive to the constrained vocabulary and recognition effects
- Raw data:
comparison/generated/FE-012C-dataset-comparison.md,FE-012C-drift-analysis.md(template, not populated at top-experiment level — populated version lives undercomparison/, see note below),semantic-repeatability-report.md - Note on internal inconsistency:
experiments/FE-012C-repeatability-run-001/comparison/drift-analysis.md(top-level) still reads as an unpopulated template ("Do not infer repeatability before results exist"), whilecomparison/generated/FE-012C-dataset-comparison.mdcontains the fully populated results above. This is a within-experiment documentation-currency defect, recorded as Failure Mode F7. - Reproducibility status: This experiment is the reproducibility test for E4. It has not itself been re-repeated a third time.
E6 — FE-013 Procedural Language Hypothesis
- Experiment ID: Not yet in the
EX-*registry (native IDFE-013) - Research question: Do procedural frameworks exhibit compiler-like structural properties (entry/exit/preconditions/postconditions/branches/loops/invariants/procedural ASTs) recoverable from blinded natural-language descriptions?
- Status: Designed and preregistered, not executed.
responses/{gpt,claude,gemini}/each contain only a.gitkeep.comparison/run-status.mdis an empty table.comparison/observations.md,ast-comparison.md,constraint-comparison.md,invariants.md,unresolved-disagreements.md,preliminary-observations.mdare all unpopulated templates carrying explicit "do not infer results before the experiment is run" guards. - Why this matters for this inventory: FE-013 is listed in
CURRENT_STATE.mdunder "Active Experiments" with a stated purpose, which could be misread as an in-progress or completed study. It is neither — it is a fully specified, zero-data experiment. This is recorded, not treated as a negative result (it is not a null result; it is an unexecuted design). - Raw data: None
- Reproducibility status: N/A (not yet run once)
E7 — ECR-000001 Multi-Layer Procedural Representation
- Experiment ID:
EX-LEGACY-ECR-000001 - Purpose (native): Instrument calibration, not hypothesis testing — explicitly converted to a calibration run per its own README ("determine whether the measurement instrument itself is reliable before using it for broader hypothesis testing")
- Primary hypotheses in scope: H003, H012, H013, H015
- Sample: 12 responses recorded in
responses/(registry:chatgpt: 3, claude: 3, gemini: 3= 9 native-registry-counted + additional per directory listing = 12 present per file count) - Result: MISSING a consolidated top-level findings document.
instrument-pass-fail.mddefines success/failure criteria but was not found populated with an outcome verdict in the files reviewed;execution-log.mdwas not fully reconstructed in this pass (see Coverage and Known Gaps). - Claimed conclusion: MISSING (not synthesized into a findings statement discoverable in this pass)
- Supported conclusion: Cannot be assessed from the artifacts reviewed. This experiment functions in the corpus primarily as the calibration precursor to ECR-000002/ECR-000003, and its packet/schema design was reused (with revision) by both.
- Reproducibility status: MISSING
- Flag: This is a Phase-14 evidence gap (missing synthesized findings for a "complete"-status registry entry) rather than a null result — the registry marks
status: "complete"with real run data present, but no reconstructed top-level conclusion was located.
E8 — ECR-000002 Recognition Sensitivity
- Experiment ID:
EX-LEGACY-ECR-000002 - Purpose: Test whether recovered procedural structure is stable across recognition levels (canonical / paraphrased / structural / graph-only) of the same underlying procedure, across artifact families P001 (reasoning-heavy), P002 (execution-heavy), P003 (static/hierarchical)
- Primary hypotheses: H013, H003, H015; secondary H001, H002, H005–H008, H011, H012, H014, H016
- Sample: Responses present (registry:
chatgpt: 2, claude: 2, gemini: 2);comparison/directory contains only 2 substantive files (p001d-graph-recognition-plan.md,p001c-observation-note.md) plus a.gitkeep— materially thinner than ECR-000001 or ECR-000003 - Result: No consolidated findings document located. This run appears to have been superseded in practice by ECR-000003, which re-scopes and re-executes an expanded version of the same recognition/representation question with a frozen comparator.
- Claimed conclusion: MISSING
- Supported conclusion: This evidence run appears functionally abandoned or absorbed into ECR-000003 rather than formally closed or superseded on paper. No supersession record was found declaring ECR-000002 superseded by ECR-000003, even though ECR-000003's own README describes itself as following on from ECR-000002's recognition-sensitivity question with an expanded design. Recorded as Failure Mode F6 (silent absorption without a supersession record).
- Reproducibility status: MISSING
E9 — ECR-000003 Representation Sensitivity (EXP-001, EXP-002, EXP-003)
- Experiment ID:
EX-LEGACY-ECR-000003 - Purpose: Which features carry procedural recognition and structural extraction — topology (EXP-001), surface representation (EXP-002), or domain semantics under matched control-flow (EXP-003)
- Hypotheses in scope: H016, H017, H018, H013, H003, H015, H002
- Instrument: Comparator
3.1.0(frozen, official measurement) with Comparator3.2.0explainability layer (non-scoring, post hoc) - Sample: EXP-001 12/12 responses, EXP-002 12/12 responses, EXP-003 9/9 responses — 33 total, 0 missing, 0 malformed; tolerant-parsing events 5 / 4 / 3 respectively; leakage findings 3 / 5 / 5 respectively
- Result:
- EXP-001 (topology perturbation): structural backbone mixed; primitive and constraint comparison disagreement; representation compliance full agreement
- EXP-002 (cross-representation): structural backbone mixed; primitive/constraint disagreement; compression/elaboration patterns observed but did not erase disagreement
- EXP-003 (cross-domain isomorphism): structural backbone, literal, conceptual, and dimensional profiles all mostly_stable; primitive sequence, transitions, dominant primitives, and constraints still in disagreement; recognition provider-dependent (GPT persistent, Claude gradual decay, Gemini persistent)
- Claimed conclusion (native,
ECR-000003-FINDINGS.md): "Consistent with limited backbone stability under some transformations, persistent provider-specific variation, and continued recognition or domain-language pressure. The run supports cautious methodological claims more strongly than broad theoretical claims." - Supported conclusion (this review): Concur with the native conclusion as written; it is already appropriately hedged. The one addition this review makes: EXP-003's "mostly_stable" backbone result is the strongest positive structural signal anywhere in the corpus, and it is exactly the result the repository's own next-research-decision process has flagged as needing an adversarial follow-up (negative non-isomorphic controls) before being trusted, precisely because a positive backbone-stability result obtained without a designed negative control cannot rule out "the comparator/rubric is lenient enough to call most things mostly_stable." This review concurs with that internal prioritization.
- Confidence claim: See Hypothesis Evidence Summary table inside
ECR-000003-FINDINGS.md— all directions in {mixed, slightly_supported, waiting}, all strengths in {weak, moderate, insufficient}. No hypothesis reaches strong/high anywhere. - Governance status: A Hypothesis Review Board packet and summary exist (
review-board/HYPOTHESIS-REVIEW-BOARD-SUMMARY.md) proposing direction/strength updates to H002, H003, H013, H015, H016, H017, H018 — butHYPOTHESIS-REVIEW-BOARD-DECISION.mdis blank (status: blank_human_decision_required). No proposed update has been ratified as of this analysis. - Raw data: Present and certified (dataset-certification step documented); reports present (
ECR-000003-FINDINGS.md,NEXT-RESEARCH-DECISION.md, explainability summaries per experiment) - Reproducibility status: Not yet independently repeated; recommended next step per the repository's own
NEXT-RESEARCH-DECISION.mdis adversarial (negative controls), not repeatability
E10 — EX-FE-0001 Framework Engineering Boundary Discrimination Pilot
- Registry status:
ready;run_count_by_provider: {manual: 6} - Research question: Can an evaluator distinguish a non-redundant FE scope from adjacent method engineering / generic structured analysis, using only current canonical claims?
- Implemented vs. stated mismatch: The only located synthesis artifact (
synthesis/synthesize--1784832869017.json) has"status": "template","findings": [],"unresolved": [],"decision": null, and the experiment folder containsfixtures/offline-normalized-result.jsonandfixtures/offline-manual-response.md. The registry'srun_count_by_provider: {manual: 6}most plausibly reflects infrastructure/fixture exercise runs rather than six substantive adjudicated evaluator trials. This inventory records the mismatch rather than resolving it; a synthesized finding was not located. - Result: No usable finding located.
- Supersession/authority:
synthesis_policyexplicitly states "No confidence update from model agreement alone."
E11 — EX-FE-0002 Blinded Mechanism Boundary and Subsumption Test
- Registry status:
ready;run_count_by_provider: {}(zero runs recorded) - Research question: Is any FE mechanism non-redundant relative to adjacent disciplines, under blinded adjudication?
- Result: Not executed. Per
FE-BOUNDARY-2026-07-28/README.md: "Stage A remains incomplete, Stage B remains blocked, and its experimental boundary classification remains inconclusive." - Note: A large body of scaffolding exists for this question under
research/evaluations/FE-BOUNDARY-2026-07-24/,FE-BOUNDARY-2026-07-24-v1.1/, andFE-BOUNDARY-2026-07-24-v1.2-machine-pilot/(mechanism cards, reviewer packets, adjudication folders, role registries). These were inventoried by directory listing but not individually reconstructed in this pass — see Coverage and Known Gaps. They appear to be iterative attempts at the same blinded mechanism-boundary test, each superseding protocol details of the last, none reaching a completed Stage B per the 07-28 package's own account.
E12 — EX-FE-0003 Uncertainty and Evidence-Lineage Ablation
- Registry status:
proposed, confidence0.5(self-declared design confidence, not evidentiary confidence) - Research question: Does explicit uncertainty representation and traceable evidence lineage improve diagnostic reasoning/decisions vs. an otherwise-equivalent framework?
- Design quality (this review): Notably rigorous as a design — pre-specifies a 27-run minimum matrix (3 trials × providers × cases), blinded scoring, adversarial review, freeze-then-unblind sequencing, explicit falsification conditions, explicit stopping conditions (identity leakage, prompt drift, unequal case information, manual repair before evaluation), and a private identity key (
identity-key.private.md) for later unblinding. - Result:
final-analysis.mdexplicitly states "Status: no execution data." Not run. - This is recorded as a positive process finding (a well-specified null-state experiment with real blinding infrastructure already built) rather than a gap in this inventory, though it remains a research-backlog item.
E13 — FE-EVAL-2026-07-23 (Repository-Wide Evaluation Package)
- Type: Meta-evaluation / evidence-synthesis artifact, itself produced by a non-human agent ("Codex") reasoning over repository text — included in scope because it is a non-human analytical process operating on non-human artifacts (the repository itself).
- Result headline: Classifies Framework Engineering as "a provisional research and method-engineering program," maturity "research prototype / pre-validation," explicitly states no confidence-assessment statement reaches High, and flags the ECR-000003 board decision as blank/unratified — i.e., independently arrived at several of the same conclusions this analysis also reaches from the primary evidence.
- Use in this analysis: Treated as evidence (a data point about how the repository's claims read to an independent evaluator), not as ground truth. Its own findings are carried into the contradiction and confidence-reassessment sections below with attribution, not silently absorbed as consensus.
E14 — FE-BOUNDARY-2026-07-28 (Successor Boundary/Definition Package)
- Type: Successor meta-evaluation, produced 5 days after E13, incorporating externally sourced comparisons (systems engineering, method engineering, design science, requirements/knowledge/ontology engineering, decision analysis, quality engineering, organizational learning, cybernetics, multi-agent systems engineering)
- Result headline: "The evidence does not support presenting FE as a distinct engineering discipline... Framework Engineering is a repository-centered research program and a candidate integrated engineering profile," and explicitly designs (but does not execute) the matched-utility experiment (Arms A/B/C/D) described in
next-experiment.md. - Status note it makes about itself: "This is a proposed successor finding. It does not overwrite the controlling
EX-FE-0002state." - Use in this analysis: Same treatment as E13 — evidence, cited with attribution, its proposed next experiment folded into the ranked backlog in
non-human-next-experiments.mdrather than duplicated.
Summary Table — Execution Status
| ID | Experiment | Status | Real response data | Consolidated findings doc | Independent replication attempted |
|---|---|---|---|---|---|
| E1 | FE-011A | Complete (internal) | Yes (6 outputs) | Yes | No |
| E2 | FE-012A | Complete (internal) | Yes (20 artifacts) | Yes | No |
| E3 | FE-012B | Complete (internal) | Yes (10 problems) | Yes | No |
| E4 | FE-012C Manual | Complete | Yes (45) | Yes | Yes (by E5) |
| E5 | FE-012C Repeatability | Complete | Yes (45) | Yes (in comparison/generated/) |
This is the replication of E4 |
| E6 | FE-013 | Designed, not executed | No (0/54 expected) | N/A | N/A |
| E7 | ECR-000001 | Registry "complete," data present | Yes (12) | Not located | MISSING |
| E8 | ECR-000002 | Registry "complete," data thin | Yes (partial) | Not located | MISSING |
| E9 | ECR-000003 | Complete, certified, frozen instrument | Yes (33) | Yes, detailed | Recommended (not yet run) |
| E10 | EX-FE-0001 | Registry "ready" | Fixture/template only | No real findings | N/A |
| E11 | EX-FE-0002 | Registry "ready," 0 runs | No | No | N/A |
| E12 | EX-FE-0003 | Proposed | No | No (explicit "no execution data") | N/A |
| E13 | FE-EVAL-2026-07-23 | Complete (meta-evaluation) | N/A (text-analytic) | Yes | Followed by E14 |
| E14 | FE-BOUNDARY-2026-07-28 | Complete (meta-evaluation) | N/A (text-analytic) | Yes | N/A |
Coverage and Known Gaps in This Inventory
This pass reconstructed 14 experiment/evaluation units from primary source documents (READMEs, protocol files, results/reports, response counts, registry.json, hypothesis-registry.md, confidence-assessment.md). It did not individually reconstruct, and marks as an open gap for the next research pass:
- The internal contents of
research/evaluations/FE-BOUNDARY-2026-07-24/,-v1.1/, and-v1.2-machine-pilot/beyond directory-level listing (mechanism cards, individual reviewer packets, adjudication records, source registries). These plausibly contain 50+ additional individually inventoriable sub-artifacts. - Individual Evidence Decision Records (EDRs) under
research/evidence-runs/*/edr/andresearch/operating-system/edr/. - The 100-artifact reference corpus (
research/corpus/artifacts/,research/corpus/batches/) as individual characterization records — only aggregatestatistics.mdwas reviewed. research/papers/,input-documents/, andresearch/frontier/were not opened.ECR-000001/execution-log.mdandECR-000003's full pipeline/orchestration logs were listed but not read line-by-line.
None of the conclusions in the companion analysis documents depend on these unread materials; where a claim would require them, it is marked MISSING rather than inferred.
Repository Validation State (recorded, not repaired)
npm run experiments:verify -- --allpassed, verifying all 10 registry entries (EX-FE-0001,EX-FE-0002,EX-LEGACY-ECR-000001/2/3,EX-LEGACY-FE-011A/012A/012B/012C-MANUAL/012C-REPEAT-001).npm run research:validatefailed withEMFILE: too many open fileswhile parsingresearch/framework-engineering/experiments/EX-FE-0003/*, even after raising the shell's file-descriptor limit to 524288. This appears to be an unbounded-concurrency defect in theresearch-publisherbuild step (attempts to open >1000 files viaPromise.allwithout a concurrency cap) rather than a content defect in any research record. Recorded as a research-system finding (see failure-mode taxonomy F8); not fixed as part of this analysis, per the instruction not to silently repair tooling encountered mid-investigation.- Git state at analysis time: HEAD
1012c0f, working tree clean except an untracked.claude/directory (local agent configuration, not a repository content change).