← Benchmark deep diveAll leaderboards

MBPP · agent evaluation

The work behind the score

Inspect a task.

Original instructions, observed actions, and the verdict for each attempt.

Pass

gpt-6-astra · 62.3s · 2 recorded actions

Original task

Write a complete Python solution to /logs/artifacts/answer.py for the following task. Write a python function to find the volume of a triangular prism. Tests supplied by the original MBPP prompt: assert find_Volume(10,8,6) == 240 assert find_Volume(3,2,2) == 6 assert find_Volume(1,2,1) == 1

Grading criteria & verdicts

Executable checksPass

Recorded benchmark evaluator · f46ca8374b4cddef97ca4208ad986049d74d296a:original-tests-seed0

reward=1; pass threshold=1.0

Rubric reviewUngraded

Recorded benchmark evaluator · none

Rubric grading is not configured for this task.

Screenshot reviewUngraded

Recorded benchmark evaluator · none

Vision grading is not configured for this task.