Skip to content

SQL, analytics and data engineering

DABstep

450 multi-step data-analysis challenges derived from payments workloads.

About DABstep

What it measures

Answer/task correctness under the benchmark evaluator.

Scope & limitations

Different from pure text-to-SQL: requires reasoning over files, documentation and operational definitions.

Evaluation environment

Data agent with Python/shell and benchmark files.

Source

Original benchmark

Dataset & task catalog ↗