SQL, analytics and data engineering / Benchmark leaderboard
Spider 2.0
Enterprise SQL/data workflows using substantial schemas, documentation and code.
No published company result yet.
This benchmark is in the research directory. Its task package, adapter and grading protocol need qualification before a hosted run can be offered.
Arrange an evaluation for your company →What this benchmark measures
Metrics
Execution/task success on the selected Spider2 setting.
Execution requirements
Warehouse or local database environment; some tracks require external accounts.
Scope and limitations
Upstream reports a Snowflake evaluation-account suspension in August 2026; resolve access or select a supported local track before promising a run.
Evaluation availability
Catalog entry. Request a managed evaluation to qualify your agent interface and the benchmark’s native grading requirements.
Sources and company fit
- Original benchmark ↗Established newer suite
Companies whose products may fit
Research recommendations based on product capabilities. These companies have not necessarily run this benchmark or integrated with Blobfish.
Compatibility notes for each company
Databricks: Capability-aligned; adapter/access to qualify
Hex: Capability-aligned; adapter/access to qualify
Julius AI: Capability-aligned; adapter/access to qualify
MotherDuck: Capability-aligned; adapter/access to qualify
Sigma: Capability-aligned; adapter/access to qualify
Snowflake: Capability-aligned; adapter/access to qualify
ThoughtSpot: Capability-aligned; adapter/access to qualify
dbt Labs: Capability-aligned; adapter/access to qualify