SQL, analytics and data engineering / Benchmark leaderboard

Data-Eng-Bench

103 dbt tasks: analytics models, fixes, snapshots and incremental pipelines.

No published company result yet.

This benchmark is in the research directory. Its task package, adapter and grading protocol need qualification before a hosted run can be offered.

Arrange an evaluation for your company →

What this benchmark measures

Metrics

Hidden tests comparing materialized tables to reference outcomes.

Execution requirements

Harbor, dbt and DuckDB or the documented Snowflake setting.

Scope and limitations

Report all 103 tasks versus the 30-task fast subset; DuckDB/Snowflake configuration can change compatibility.

Evaluation availability

Catalog entry. Request a managed evaluation to qualify your agent interface and the benchmark’s native grading requirements.

Sources and company fit

Companies whose products may fit

Research recommendations based on product capabilities. These companies have not necessarily run this benchmark or integrated with Blobfish.

Compatibility notes for each company

Augment Code: Capability-aligned; adapter/access to qualify

Databricks: Capability-aligned; adapter/access to qualify

Factory: Capability-aligned; adapter/access to qualify

MotherDuck: Capability-aligned; adapter/access to qualify

Snowflake: Capability-aligned; adapter/access to qualify

dbt Labs: Capability-aligned; adapter/access to qualify