research-document
FE-012A Analysis Plan
FE-012A Analysis Plan
- Primitive frequency analysis
- Vocabulary stabilization analysis
- Extractor agreement review
- Reconstruction success review
- Ambiguity analysis
- Proposed primitive additions
- Candidate removals or merges
- Holdout testing with Clarity and EDF after vocabulary freeze
Constraints
- Do not test Clarity or EDF until after the initial primitive vocabulary is frozen.
- Treat vocabulary growth as a measurement, not as automatic failure or success.
- Separate domain transfer problems from extractor disagreement problems where possible.