Blobfish AICustomer release
Interactive regression world · loading

NorthstarComposite Operations World

A deterministic, stateful companion to the substantive customer release—100 tasks across five MCP servers, with executable verifiers, replayable traces, and a source-backed research bundle.

WORLD HEALTHLoading
/

oracle tasks verified

Mutation score
False positives
False negatives
Trace replay
tasks— balanced categories
toolstyped & executable
MCP serversplus composite host
DAG edges— back edges
mutants killed— verifier survivors
Evidence boundary — read before comparing models

The reference-policy traces are deterministic fixtures used to validate failure analysis. They are not provider outputs or model rankings. Empirical model traces in this artifact: 0. The separately named Northstar regression archive includes a metered live runner with an optional spend ceiling for new provider evidence.

Read methodology →
01 · PLAY THE WORLD

Replay a grounded task

Choose any of the 100 tasks, then step through its executable reference policy. Each tool call mutates a fresh logical episode and ends in exact SQL state checks.

Loading task runner…

This player replays the programmatic oracle—not a provider trace. Every run shown here is deterministic and uses the checked-in seed.

02 · FAILURE MODES

Diagnose every reference policy

The three rows are intentionally injected policy profiles, paired with deterministic signatures and exact verifier evidence. They are pipeline tests, not stand-ins for model scores.

No broken or misclassified task remains

canonical oracles + valid alternate plans passed; all adversarial mutants were rejected.

0 false positives0 false negatives0 environment failures
Open audit JSON
03 · TRACE EXPLORER

Every call. Every check. All —.

Switch reference policies, search their records, isolate a failure signature, and replay the observable tool trajectory beside its verifier result.

JSON ↓
0/100 traces
Select a trace to inspect it.
04 · TOOL DAG

A real DAG, with proof

All — functions are nodes in a —-edge directed acyclic graph. Kahn’s algorithm visits every node, and every edge points from a lower to a higher rank.

05 · TAKE IT WITH YOU

Ship the substantive customer world.

The primary archive contains executable tools across namespaces, training-eligible tasks, content-bound seed assets, executable verifiers, oracle receipts, and a live single-model failure dossier.

Download customer releaseLoading size · tar.gz
SHA-256loading…