Typed Decision Bench · tasks · Data and operations

`trial-outcomes`

feature extraction for ml · saas growth · 400 items · primary question type noul. Source synthetic:saas-trial-v1 (CC-BY-4.0 (generated here)); labels are oracle labels, never an LLM judge. Download these samples (JSON).

System	DecisionScore	Accuracy (top pick)	Answered
Jev	78.8	67.8%	400 / 400
decider-2b	77.8	69.5%	400 / 400
System One Scorer	77.7	69.5%	400 / 400
NanoJev	76.4	69.5%	400 / 400
JevFish	72.2	69.5%	400 / 400
OpenJev	69.4	69.3%	400 / 400

Sample 1 of 6 · data-and-operations:trial-10806 · 275 state tokens (common tier)

Turn 1 — the request (identical for every system)

State (JSON)

{
  "definitions": {
    "activated_7d": "The account reaches the product's activation milestone (a saved workflow run by 2+ seats) within 7 days of sign-up.",
    "upgraded_30d": "The account converts from trial to a paid plan within 30 days; an account that never activates does not upgrade.",
    "ticket_opened_14d": "The account opens at least one support ticket within 14 days of sign-up.",
    "renewed_annual": "The account renews its annual commitment at the first renewal date; only asked when billing_cycle is annual."
  },
  "account": {
    "company_size": "51-200",
    "industry": "healthcare",
    "region": "na",
    "signup_channel": "organic",
    "plan": "business",
    "billing_cycle": "annual",
    "role": "manager",
    "device": "mobile",
    "seats_requested": 9,
    "days_since_signup": 2,
    "onboarding_steps_done": 8,
    "sessions_first_3d": 4,
    "integrations_connected": 2,
    "invites_sent": 5,
    "docs_pages_viewed": 14,
    "prior_trials": 0,
    "competitor_tools": 1,
    "marketing_touches_30d": 2,
    "sales_assist": 0,
    "discount_pct": 20,
    "signup_hour": 14,
    "signup_weekday": 6,
    "nps_intent": null,
    "seat_growth_signal": 0.3051
  }
}

Question activated_7d · noul

Will activated_7d happen for state.account, as defined in state.definitions.activated_7d? Judge from the account fields only.

2 options

yes
no

Turn 2 — each system's response · Turn 3 — the grade

Expected answer: yes

System	Top pick	Grade	P(expected)	Proper score	Distribution
Jev	`yes`	correct	71.0%	0.916	`yes` 71.0% `no` 29.0%
decider-2b	`yes`	correct	65.1%	0.878	`yes` 65.1% `no` 34.9%
System One Scorer	`yes` input truncated	correct	68.5%	0.901	`yes` 68.5% `no` 31.5%
NanoJev	`yes`	correct	51.7%	0.767	`yes` 51.7% `no` 48.3%
JevFish	`no`	wrong	26.6%	0.462	`yes` 26.6% `no` 73.4%
OpenJev	`yes`	correct	73.9%	0.932	`yes` 73.9% `no` 26.1%

Question upgraded_30d · noul · primary (ranked)

Will upgraded_30d happen for state.account, as defined in state.definitions.upgraded_30d? Judge from the account fields only.

2 options

yes
no

Turn 2 — each system's response · Turn 3 — the grade

Expected answer: yes

System	Top pick	Grade	P(expected)	Proper score	Distribution
Jev	`yes`	correct	64.0%	0.870	`yes` 64.0% `no` 36.0%
decider-2b	`no`	wrong	15.0%	0.278	`yes` 15.0% `no` 85.0%
System One Scorer	`no` input truncated	wrong	38.0%	0.616	`yes` 38.0% `no` 62.0%
NanoJev	`no`	wrong	14.1%	0.263	`yes` 14.1% `no` 85.9%
JevFish	`no`	wrong	12.6%	0.235	`yes` 12.6% `no` 87.4%
OpenJev	`no`	wrong	9.7%	0.184	`yes` 9.7% `no` 90.3%

Question ticket_opened_14d · noul

Will ticket_opened_14d happen for state.account, as defined in state.definitions.ticket_opened_14d? Judge from the account fields only.

2 options

yes
no

Turn 2 — each system's response · Turn 3 — the grade

Expected answer: yes

System	Top pick	Grade	P(expected)	Proper score	Distribution
Jev	`no`	wrong	29.0%	0.496	`yes` 29.0% `no` 71.0%
decider-2b	`no`	wrong	36.0%	0.590	`yes` 36.0% `no` 64.0%
System One Scorer	`no` input truncated	wrong	37.2%	0.606	`yes` 37.2% `no` 62.8%
NanoJev	`no`	wrong	26.1%	0.454	`yes` 26.1% `no` 73.9%
JevFish	`no`	wrong	19.3%	0.349	`yes` 19.3% `no` 80.7%
OpenJev	`no`	wrong	0.9%	0.018	`yes` 0.9% `no` 99.1%

Question renewed_annual · noul

Will renewed_annual happen for state.account, as defined in state.definitions.renewed_annual? Judge from the account fields only.

2 options

yes
no

Turn 2 — each system's response · Turn 3 — the grade

Expected answer: yes

System	Top pick	Grade	P(expected)	Proper score	Distribution
Jev	`no`	wrong	39.0%	0.628	`yes` 39.0% `no` 61.0%
decider-2b	`no`	wrong	47.6%	0.725	`yes` 47.6% `no` 52.4%
System One Scorer	`no` input truncated	wrong	46.9%	0.718	`yes` 46.9% `no` 53.1%
NanoJev	`no`	wrong	29.2%	0.498	`yes` 29.2% `no` 70.8%
JevFish	`no`	wrong	14.0%	0.260	`yes` 14.0% `no` 86.1%
OpenJev	`no`	wrong	16.9%	0.310	`yes` 16.9% `no` 83.1%

Sample 2 of 6 · data-and-operations:trial-16803 · 247 state tokens (common tier)

Turn 1 — the request (identical for every system)

State (JSON)

{
  "definitions": {
    "activated_7d": "The account reaches the product's activation milestone (a saved workflow run by 2+ seats) within 7 days of sign-up.",
    "upgraded_30d": "The account converts from trial to a paid plan within 30 days; an account that never activates does not upgrade.",
    "ticket_opened_14d": "The account opens at least one support ticket within 14 days of sign-up."
  },
  "account": {
    "company_size": "51-200",
    "industry": "healthcare",
    "region": "na",
    "signup_channel": "paid_search",
    "plan": "starter",
    "billing_cycle": "monthly",
    "role": "founder",
    "device": "desktop",
    "seats_requested": 3,
    "days_since_signup": 3,
    "onboarding_steps_done": 5,
    "sessions_first_3d": 9,
    "integrations_connected": 2,
    "invites_sent": 1,
    "docs_pages_viewed": 15,
    "prior_trials": 0,
    "competitor_tools": 0,
    "marketing_touches_30d": 9,
    "sales_assist": 1,
    "discount_pct": 30,
    "signup_hour": 12,
    "signup_weekday": 6,
    "nps_intent": 8,
    "seat_growth_signal": null
  }
}

Question activated_7d · noul

Will activated_7d happen for state.account, as defined in state.definitions.activated_7d? Judge from the account fields only.

2 options

yes
no

Turn 2 — each system's response · Turn 3 — the grade

Expected answer: yes

System	Top pick	Grade	P(expected)	Proper score	Distribution
Jev	`yes`	correct	68.0%	0.898	`yes` 68.0% `no` 32.0%
decider-2b	`yes`	correct	65.1%	0.878	`yes` 65.1% `no` 34.9%
System One Scorer	`yes` input truncated	correct	72.8%	0.926	`yes` 72.8% `no` 27.2%
NanoJev	`yes`	correct	54.5%	0.793	`yes` 54.5% `no` 45.5%
JevFish	`no`	wrong	18.9%	0.342	`yes` 18.9% `no` 81.1%
OpenJev	`yes`	correct	55.6%	0.803	`yes` 55.6% `no` 44.4%

Question upgraded_30d · noul · primary (ranked)

Will upgraded_30d happen for state.account, as defined in state.definitions.upgraded_30d? Judge from the account fields only.

2 options

yes
no

Turn 2 — each system's response · Turn 3 — the grade

Expected answer: yes

System	Top pick	Grade	P(expected)	Proper score	Distribution
Jev	`yes`	correct	58.0%	0.824	`yes` 58.0% `no` 42.0%
decider-2b	`no`	wrong	34.9%	0.576	`yes` 34.9% `no` 65.1%
System One Scorer	`no` input truncated	wrong	40.6%	0.647	`yes` 40.6% `no` 59.4%
NanoJev	`no`	wrong	19.9%	0.359	`yes` 19.9% `no` 80.1%
JevFish	`no`	wrong	13.7%	0.255	`yes` 13.7% `no` 86.3%
OpenJev	`no`	wrong	1.4%	0.028	`yes` 1.4% `no` 98.6%

Question ticket_opened_14d · noul

Will ticket_opened_14d happen for state.account, as defined in state.definitions.ticket_opened_14d? Judge from the account fields only.

2 options

yes
no

Turn 2 — each system's response · Turn 3 — the grade

Expected answer: no

System	Top pick	Grade	P(expected)	Proper score	Distribution
Jev	`no`	correct	72.0%	0.922	`yes` 28.0% `no` 72.0%
decider-2b	`no`	correct	54.8%	0.796	`yes` 45.2% `no` 54.8%
System One Scorer	`no` input truncated	correct	59.4%	0.835	`yes` 40.6% `no` 59.4%
NanoJev	`no`	correct	73.6%	0.930	`yes` 26.4% `no` 73.6%
JevFish	`no`	correct	81.0%	0.964	`yes` 18.9% `no` 81.0%
OpenJev	`no`	correct	99.2%	1.000	`yes` 0.8% `no` 99.2%

Sample 3 of 6 · data-and-operations:trial-17721 · 248 state tokens (common tier)

Turn 1 — the request (identical for every system)

State (JSON)

{
  "definitions": {
    "activated_7d": "The account reaches the product's activation milestone (a saved workflow run by 2+ seats) within 7 days of sign-up.",
    "upgraded_30d": "The account converts from trial to a paid plan within 30 days; an account that never activates does not upgrade.",
    "ticket_opened_14d": "The account opens at least one support ticket within 14 days of sign-up."
  },
  "account": {
    "company_size": "51-200",
    "industry": "software",
    "region": "na",
    "signup_channel": "partner",
    "plan": "starter",
    "billing_cycle": "monthly",
    "role": "ic",
    "device": "desktop",
    "seats_requested": 8,
    "days_since_signup": 3,
    "onboarding_steps_done": 1,
    "sessions_first_3d": 0,
    "integrations_connected": 0,
    "invites_sent": 0,
    "docs_pages_viewed": 0,
    "prior_trials": 2,
    "competitor_tools": 2,
    "marketing_touches_30d": 0,
    "sales_assist": 1,
    "discount_pct": 20,
    "signup_hour": 11,
    "signup_weekday": 6,
    "nps_intent": 5.9,
    "seat_growth_signal": 0.4481
  }
}

Question activated_7d · noul

Will activated_7d happen for state.account, as defined in state.definitions.activated_7d? Judge from the account fields only.

2 options

yes
no

Turn 2 — each system's response · Turn 3 — the grade

Expected answer: yes

System	Top pick	Grade	P(expected)	Proper score	Distribution
Jev	`no`	wrong	22.0%	0.392	`yes` 22.0% `no` 78.0%
decider-2b	`no`	wrong	12.2%	0.230	`yes` 12.2% `no` 87.8%
System One Scorer	`yes` input truncated	correct	57.9%	0.823	`yes` 57.9% `no` 42.1%
NanoJev	`yes`	correct	55.3%	0.800	`yes` 55.3% `no` 44.7%
JevFish	`no`	wrong	18.0%	0.328	`yes` 18.0% `no` 82.0%
OpenJev	`no`	wrong	0.3%	0.005	`yes` 0.3% `no` 99.7%

Question upgraded_30d · noul · primary (ranked)

Will upgraded_30d happen for state.account, as defined in state.definitions.upgraded_30d? Judge from the account fields only.

2 options

yes
no

Turn 2 — each system's response · Turn 3 — the grade

Expected answer: yes

System	Top pick	Grade	P(expected)	Proper score	Distribution
Jev	`no`	wrong	20.0%	0.360	`yes` 20.0% `no` 80.0%
decider-2b	`no`	wrong	12.2%	0.230	`yes` 12.2% `no` 87.8%
System One Scorer	`no` input truncated	wrong	36.9%	0.602	`yes` 36.9% `no` 63.1%
NanoJev	`no`	wrong	16.2%	0.298	`yes` 16.2% `no` 83.8%
JevFish	`no`	wrong	11.8%	0.222	`yes` 11.8% `no` 88.2%
OpenJev	`no`	wrong	1.8%	0.036	`yes` 1.8% `no` 98.2%

Question ticket_opened_14d · noul

Will ticket_opened_14d happen for state.account, as defined in state.definitions.ticket_opened_14d? Judge from the account fields only.

2 options

yes
no

Turn 2 — each system's response · Turn 3 — the grade

Expected answer: no

System	Top pick	Grade	P(expected)	Proper score	Distribution
Jev	`no`	correct	71.0%	0.916	`yes` 29.0% `no` 71.0%
decider-2b	`no`	correct	78.5%	0.954	`yes` 21.4% `no` 78.5%
System One Scorer	`no` input truncated	correct	68.1%	0.898	`yes` 31.9% `no` 68.1%
NanoJev	`no`	correct	72.8%	0.926	`yes` 27.2% `no` 72.8%
JevFish	`no`	correct	83.0%	0.971	`yes` 17.0% `no` 83.0%
OpenJev	`no`	correct	99.9%	1.000	`yes` 0.1% `no` 99.9%

Sample 4 of 6 · data-and-operations:trial-17872 · 247 state tokens (common tier)

Turn 1 — the request (identical for every system)

State (JSON)

{
  "definitions": {
    "activated_7d": "The account reaches the product's activation milestone (a saved workflow run by 2+ seats) within 7 days of sign-up.",
    "upgraded_30d": "The account converts from trial to a paid plan within 30 days; an account that never activates does not upgrade.",
    "ticket_opened_14d": "The account opens at least one support ticket within 14 days of sign-up."
  },
  "account": {
    "company_size": "1-10",
    "industry": "fintech",
    "region": "eu",
    "signup_channel": "product_referral",
    "plan": "team",
    "billing_cycle": "monthly",
    "role": "ic",
    "device": "mobile",
    "seats_requested": 1,
    "days_since_signup": 3,
    "onboarding_steps_done": 2,
    "sessions_first_3d": 3,
    "integrations_connected": 0,
    "invites_sent": 0,
    "docs_pages_viewed": 6,
    "prior_trials": 0,
    "competitor_tools": 0,
    "marketing_touches_30d": 1,
    "sales_assist": 0,
    "discount_pct": 0,
    "signup_hour": 8,
    "signup_weekday": 4,
    "nps_intent": 6.3,
    "seat_growth_signal": 0.469
  }
}

Question activated_7d · noul

Will activated_7d happen for state.account, as defined in state.definitions.activated_7d? Judge from the account fields only.

2 options

yes
no

Turn 2 — each system's response · Turn 3 — the grade

Expected answer: yes

System	Top pick	Grade	P(expected)	Proper score	Distribution
Jev	`no`	wrong	30.0%	0.510	`yes` 30.0% `no` 70.0%
decider-2b	`yes`	correct	59.5%	0.836	`yes` 59.5% `no` 40.5%
System One Scorer	`yes` input truncated	correct	57.4%	0.818	`yes` 57.4% `no` 42.6%
NanoJev	`yes`	correct	50.5%	0.755	`yes` 50.5% `no` 49.5%
JevFish	`no`	wrong	23.1%	0.409	`yes` 23.1% `no` 76.9%
OpenJev	`no`	wrong	0.2%	0.004	`yes` 0.2% `no` 99.8%

Question upgraded_30d · noul · primary (ranked)

Will upgraded_30d happen for state.account, as defined in state.definitions.upgraded_30d? Judge from the account fields only.

2 options

yes
no

Turn 2 — each system's response · Turn 3 — the grade

Expected answer: yes

System	Top pick	Grade	P(expected)	Proper score	Distribution
Jev	`no`	wrong	31.0%	0.524	`yes` 31.0% `no` 69.0%
decider-2b	`no`	wrong	24.0%	0.422	`yes` 24.0% `no` 76.0%
System One Scorer	`no` input truncated	wrong	29.4%	0.501	`yes` 29.4% `no` 70.6%
NanoJev	`no`	wrong	15.6%	0.288	`yes` 15.6% `no` 84.4%
JevFish	`no`	wrong	13.3%	0.249	`yes` 13.3% `no` 86.7%
OpenJev	`no`	wrong	5.4%	0.106	`yes` 5.4% `no` 94.6%

Question ticket_opened_14d · noul

Will ticket_opened_14d happen for state.account, as defined in state.definitions.ticket_opened_14d? Judge from the account fields only.

2 options

yes
no

Turn 2 — each system's response · Turn 3 — the grade

Expected answer: no

System	Top pick	Grade	P(expected)	Proper score	Distribution
Jev	`no`	correct	75.0%	0.938	`yes` 25.0% `no` 75.0%
decider-2b	`no`	correct	59.5%	0.836	`yes` 40.5% `no` 59.5%
System One Scorer	`no` input truncated	correct	68.6%	0.901	`yes` 31.4% `no` 68.6%
NanoJev	`no`	correct	74.2%	0.933	`yes` 25.8% `no` 74.2%
JevFish	`no`	correct	81.7%	0.967	`yes` 18.3% `no` 81.7%
OpenJev	`no`	correct	99.3%	1.000	`yes` 0.7% `no` 99.3%

Sample 5 of 6 · data-and-operations:trial-18667 · 248 state tokens (common tier)

Turn 1 — the request (identical for every system)

State (JSON)

{
  "definitions": {
    "activated_7d": "The account reaches the product's activation milestone (a saved workflow run by 2+ seats) within 7 days of sign-up.",
    "upgraded_30d": "The account converts from trial to a paid plan within 30 days; an account that never activates does not upgrade.",
    "ticket_opened_14d": "The account opens at least one support ticket within 14 days of sign-up."
  },
  "account": {
    "company_size": "11-50",
    "industry": "software",
    "region": "na",
    "signup_channel": "partner",
    "plan": "starter",
    "billing_cycle": "monthly",
    "role": "manager",
    "device": "desktop",
    "seats_requested": 4,
    "days_since_signup": 2,
    "onboarding_steps_done": 8,
    "sessions_first_3d": 3,
    "integrations_connected": 1,
    "invites_sent": 7,
    "docs_pages_viewed": 27,
    "prior_trials": 0,
    "competitor_tools": 3,
    "marketing_touches_30d": 1,
    "sales_assist": 0,
    "discount_pct": 30,
    "signup_hour": 21,
    "signup_weekday": 6,
    "nps_intent": 8.5,
    "seat_growth_signal": 0.3484
  }
}

Question activated_7d · noul

Will activated_7d happen for state.account, as defined in state.definitions.activated_7d? Judge from the account fields only.

2 options

yes
no

Turn 2 — each system's response · Turn 3 — the grade

Expected answer: yes

System	Top pick	Grade	P(expected)	Proper score	Distribution
Jev	`yes`	correct	72.0%	0.922	`yes` 72.0% `no` 28.0%
decider-2b	`yes`	correct	60.7%	0.845	`yes` 60.7% `no` 39.4%
System One Scorer	`yes` input truncated	correct	68.9%	0.903	`yes` 68.9% `no` 31.1%
NanoJev	`yes`	correct	53.6%	0.784	`yes` 53.6% `no` 46.4%
JevFish	`no`	wrong	23.7%	0.418	`yes` 23.7% `no` 76.3%
OpenJev	`no`	wrong	11.6%	0.218	`yes` 11.6% `no` 88.4%

Question upgraded_30d · noul · primary (ranked)

Will upgraded_30d happen for state.account, as defined in state.definitions.upgraded_30d? Judge from the account fields only.

2 options

yes
no

Turn 2 — each system's response · Turn 3 — the grade

Expected answer: yes

System	Top pick	Grade	P(expected)	Proper score	Distribution
Jev	`yes`	correct	54.0%	0.788	`yes` 54.0% `no` 46.0%
decider-2b	`no`	wrong	24.0%	0.422	`yes` 24.0% `no` 76.0%
System One Scorer	`no` input truncated	wrong	38.0%	0.616	`yes` 38.0% `no` 62.0%
NanoJev	`no`	wrong	14.9%	0.276	`yes` 14.9% `no` 85.1%
JevFish	`no`	wrong	13.5%	0.252	`yes` 13.5% `no` 86.5%
OpenJev	`no`	wrong	3.6%	0.070	`yes` 3.6% `no` 96.4%

Question ticket_opened_14d · noul

Will ticket_opened_14d happen for state.account, as defined in state.definitions.ticket_opened_14d? Judge from the account fields only.

2 options

yes
no

Turn 2 — each system's response · Turn 3 — the grade

Expected answer: yes

System	Top pick	Grade	P(expected)	Proper score	Distribution
Jev	`no`	wrong	26.0%	0.452	`yes` 26.0% `no` 74.0%
decider-2b	`no`	wrong	40.5%	0.646	`yes` 40.5% `no` 59.5%
System One Scorer	`no` input truncated	wrong	41.7%	0.660	`yes` 41.7% `no` 58.3%
NanoJev	`no`	wrong	29.7%	0.505	`yes` 29.7% `no` 70.3%
JevFish	`no`	wrong	18.9%	0.342	`yes` 18.9% `no` 81.1%
OpenJev	`no`	wrong	0.7%	0.014	`yes` 0.7% `no` 99.3%

Sample 6 of 6 · data-and-operations:trial-5533 · 249 state tokens (common tier)

Turn 1 — the request (identical for every system)

State (JSON)

{
  "definitions": {
    "activated_7d": "The account reaches the product's activation milestone (a saved workflow run by 2+ seats) within 7 days of sign-up.",
    "upgraded_30d": "The account converts from trial to a paid plan within 30 days; an account that never activates does not upgrade.",
    "ticket_opened_14d": "The account opens at least one support ticket within 14 days of sign-up."
  },
  "account": {
    "company_size": "51-200",
    "industry": "software",
    "region": "na",
    "signup_channel": "paid_search",
    "plan": "starter",
    "billing_cycle": "monthly",
    "role": "founder",
    "device": "desktop",
    "seats_requested": 8,
    "days_since_signup": 3,
    "onboarding_steps_done": 3,
    "sessions_first_3d": 1,
    "integrations_connected": 0,
    "invites_sent": 0,
    "docs_pages_viewed": 2,
    "prior_trials": 0,
    "competitor_tools": 1,
    "marketing_touches_30d": 5,
    "sales_assist": 0,
    "discount_pct": 10,
    "signup_hour": 2,
    "signup_weekday": 2,
    "nps_intent": 3.2,
    "seat_growth_signal": 0.6005
  }
}

Question activated_7d · noul

Will activated_7d happen for state.account, as defined in state.definitions.activated_7d? Judge from the account fields only.

2 options

yes
no

Turn 2 — each system's response · Turn 3 — the grade

Expected answer: no

System	Top pick	Grade	P(expected)	Proper score	Distribution
Jev	`no`	correct	64.0%	0.870	`yes` 36.0% `no` 64.0%
decider-2b	`no`	correct	74.2%	0.933	`yes` 25.8% `no` 74.2%
System One Scorer	`yes` input truncated	wrong	33.0%	0.551	`yes` 67.0% `no` 33.0%
NanoJev	`yes`	wrong	45.1%	0.699	`yes` 54.9% `no` 45.1%
JevFish	`no`	correct	81.4%	0.966	`yes` 18.6% `no` 81.4%
OpenJev	`no`	correct	97.8%	1.000	`yes` 2.2% `no` 97.8%

Question upgraded_30d · noul · primary (ranked)

Will upgraded_30d happen for state.account, as defined in state.definitions.upgraded_30d? Judge from the account fields only.

2 options

yes
no

Turn 2 — each system's response · Turn 3 — the grade

Expected answer: no

System	Top pick	Grade	P(expected)	Proper score	Distribution
Jev	`no`	correct	69.0%	0.904	`yes` 31.0% `no` 69.0%
decider-2b	`no`	correct	83.0%	0.971	`yes` 17.0% `no` 83.0%
System One Scorer	`no` input truncated	correct	61.7%	0.853	`yes` 38.3% `no` 61.7%
NanoJev	`no`	correct	82.2%	0.968	`yes` 17.8% `no` 82.2%
JevFish	`no`	correct	87.2%	0.984	`yes` 12.8% `no` 87.2%
OpenJev	`no`	correct	96.7%	0.999	`yes` 3.3% `no` 96.7%

Question ticket_opened_14d · noul

Will ticket_opened_14d happen for state.account, as defined in state.definitions.ticket_opened_14d? Judge from the account fields only.

2 options

yes
no

Turn 2 — each system's response · Turn 3 — the grade

Expected answer: no

System	Top pick	Grade	P(expected)	Proper score	Distribution
Jev	`no`	correct	72.0%	0.922	`yes` 28.0% `no` 72.0%
decider-2b	`no`	correct	68.3%	0.900	`yes` 31.7% `no` 68.3%
System One Scorer	`no` input truncated	correct	63.6%	0.868	`yes` 36.4% `no` 63.6%
NanoJev	`no`	correct	71.1%	0.916	`yes` 28.9% `no` 71.1%
JevFish	`no`	correct	81.9%	0.967	`yes` 18.1% `no` 81.9%
OpenJev	`no`	correct	99.7%	1.000	`yes` 0.3% `no` 99.7%