research-document
FE-012B Evaluation Rubric
FE-012B Evaluation Rubric
Independent reviewer evaluates:
- Internal coherence
- Completeness
- Simplicity
- Missing reasoning steps
- Primitive sufficiency
- Unnecessary primitives
Ratings:
- Strong
- Moderate
- Weak
- Unclear
Reviewer Guidance
- Judge the synthesized framework as a procedural reasoning artifact, not as a proven domain solution.
- Penalize frameworks that depend on hidden domain knowledge not represented in the sequence.
- Distinguish "too simple to function" from "appropriately simple."
- If a framework seems to require an unrepresented reasoning move, record it explicitly instead of inferring it away.