research-document

FE-012A Protocol

FE-012A Protocol

Phase 1. Artifact Selection

  • Use 20 artifacts from diverse domains.
  • Exclude Clarity and EDF from the extraction set.
  • Preserve the candidate list unless there is a documented reason to substitute an artifact.

Phase 2. Blinding

Remove or mask:

  • artifact name
  • domain-specific labels where practical
  • author
  • historical origin
  • popularity
  • implementation examples

Keep:

  • procedural flow
  • reasoning steps
  • decision structure
  • evaluation criteria

Document the blinding level and what was removed for each artifact.

Phase 3. Verb Extraction

Extractor records:

  • raw verb phrase
  • surrounding context
  • inferred reasoning operation
  • confidence
  • notes

Extraction should focus on reasoning verbs and operations rather than nouns, topic labels, or diagram structure.

Phase 4. Primitive Normalization

  • Normalize cautiously.
  • Merge only when the reasoning function appears equivalent.
  • Preserve disagreements rather than forcing early convergence.
  • Document every synonym merge and every uncertain candidate primitive.

Phase 5. Vocabulary Tracking

  • Track vocabulary growth after each artifact.
  • Record new raw verbs, new normalized primitives, and new candidate primitives.
  • Watch for stabilization rather than assuming it.

Phase 6. Reconstruction

  • Select extracted primitive sequences from blinded artifacts.
  • Remove artifact names and domain cues.
  • Give only the primitive sequence to a reconstruction analyst.
  • Ask the analyst to reconstruct the reasoning flow in plain language.
  • Compare the reconstruction to the original artifact structure.

Phase 7. Holdout Testing

  • Freeze the initial primitive vocabulary before holdout testing.
  • Do not test Clarity or EDF until the vocabulary is frozen.
  • Use holdout testing to see whether the frozen primitive set transfers without modification.

Phase 8. Analysis

  • Review primitive frequency.
  • Review vocabulary stabilization.
  • Review extractor agreement.
  • Review reconstruction success and failure patterns.
  • Review ambiguity and disputed merges.

Execution Notes

  • Treat failure as useful evidence.
  • Do not claim the primitive vocabulary is complete.
  • Do not derive primitives from Framework Engineering terminology.