SQL, analytics and data engineering / Benchmark leaderboard

DSBench

Data analysis and data modeling tasks grounded in real data-science workflows.

No published company result yet.

This benchmark is in the research directory. Its task package, adapter and grading protocol need qualification before a hosted run can be offered.

Arrange an evaluation for your company →

What this benchmark measures

Metrics

Analysis-answer correctness and modeling metrics by task.

Execution requirements

Notebook/code agent with datasets and execution tools.

Scope and limitations

Distinguish analysis and modeling tracks; GPU/data dependencies may make costs uneven.

Evaluation availability

Catalog entry. Request a managed evaluation to qualify your agent interface and the benchmark’s native grading requirements.

Sources and company fit

Companies whose products may fit

Research recommendations based on product capabilities. These companies have not necessarily run this benchmark or integrated with Blobfish.

Compatibility notes for each company

Databricks: Capability-aligned; adapter/access to qualify

Google DeepMind: Capability-aligned; adapter/access to qualify

Hex: Capability-aligned; adapter/access to qualify

Julius AI: Capability-aligned; adapter/access to qualify

OpenAI: Capability-aligned; adapter/access to qualify

Snowflake: Capability-aligned; adapter/access to qualify