research-document
ECR-000003 Automated Analysis Pipeline
ECR-000003 Automated Analysis Pipeline
Quick Start
Verify only:
npm run verify
Dry-run everything:
npm run pipeline:dry
Normalize response files:
npm run normalize
Run comparisons only:
npm run compare:all
Run explainability only:
npm run explain:all
npm run reports:explainability
Generate summary reports only:
npm run reports:all
Run complete pipeline:
npm run pipeline
Run one experiment:
node scripts/run-ecr-000003.js --experiment EXP-002 --compare-all
Safe Recommended Sequence
npm run collect:exp003npm run normalize:drynpm run normalizenpm run normalize:verifynpm run normalize:certifynpm run pipeline:dry- Review normalization and completeness reports.
npm run pipelinenpm run explain:allnpm run reports:explainability- Review final readiness report.
- Complete EDRs manually.
Phone Upload Workflow
- Put phone-saved responses under:
incoming-responses/gpt/incoming-responses/claude/incoming-responses/gemini/ - Response metadata must include
packet_id. - Run
npm run normalize. - Run
npm run pipeline.
Collection First
Use response collection before normalization:
- Collect responses.
- Normalize responses.
- Verify dataset.
- Generate normalization certificates.
- Run Comparator v3.1.
- Run Comparator 3.2 explainability.
- Generate ECR-level explainability reports.
- Review EDRs.
Important Guardrails
- Raw responses are never rewritten.
- Comparators do not update hypotheses.
- EDRs require human completion.
- Pipeline success does not equal hypothesis validation.
- Comparator v3.1 remains frozen for ECR-000003.
- Comparator 3.2 explanations do not rescore or replace v3.1.