CostBench: an open benchmark for data warehouse cost-performance
CostBench is a new open benchmark designed to evaluate the cost-performance of cloud data warehouses, focusing on performance per dollar rather than just speed. It aims to help teams select systems that provide the best value for real-time analytical workloads by measuring both read and write-side cost-performance. The benchmark is open and reproducible, allowing users to inspect results and methodologies for transparency.
- ▪CostBench measures how much query performance is achieved per dollar spent on cloud data warehouses.
- ▪The first release focuses on read-side performance, comparing major platforms like ClickHouse Cloud, Snowflake, and Databricks.
- ▪ClickHouse Cloud demonstrated superior cost-performance, remaining efficient as data scales compared to its competitors.
Opening excerpt (first ~120 words) tap to expand
TL;DR CostBench is an open benchmark for cloud data warehouse cost-performance: performance-per-dollar, not just speed.It helps teams choose the system that delivers the most performance per dollar for real-time analytical workloads. Performance alone is only half the story # Most benchmarks tell you how fast a query runs. That is useful, but incomplete. In cloud data platforms, speed and cost are inseparable. If warehouse A is faster than warehouse B, A looks better on a performance chart. But if A costs three times more to run, the comparison changes. You might spend the same budget on a larger configuration of B, get more compute, and make B faster than A for less money overall.
…
Excerpt limited to ~120 words for fair-use compliance. The full article is at ClickHouse.
Discussion
0 commentsMore from ClickHouse
%2Ffile%2Fdailymaverick%2Fwp-content%2Fuploads%2F2025%2F11%2FProfile-pic-1.jpg&w=320)
