CRM operations
Arc CRM 6
Independent synthetic CRM work across contact onboarding, stage correction, bounded quotes, quote replacement, unsigned contracts and corrected document associations. All source conversations were inspected; zero source rows are reproduced.
About Arc CRM 6
What it measures
Deterministic evidence, post-write readback, outcome, containment, handoff and structured-answer checks over saved SQLite state. All 167 authoring negative controls reject. Reference controls establish solvability, not model performance.
Scope & limitations
This Blobfish suite has its own task and environment definitions. Upstream scores and reference controls are not company performance scores.
Evaluation environment
Package 0.1.2 exposes 31 domain/evidence contracts plus context and answer controls through CLI, real HTML forms, REST and MCP sharing an isolated episode-local world. A separate networkless verifier grades the collected state. Six source-inspired workflows and 33 synthetic evidence files (PDF, XLSX, EML and Markdown) are partial coverage, not 1,200 converted conversations or upstream API parity.