Polars 2.0 beats DuckDB and DataFusion in TPC-H and TPC-DS benchmarks
Release of Polars 2.0
Polars 2.0 ships with streaming and out-of-core enabled by default, first-class SQL support, and a new Map datatype. In TPC-H and TPC-DS benchmarks, Polars outperforms DuckDB 1.5.6, DuckDB 2.0 alpha, and DataFusion 54.0.0 on both 16-core and 192-core machines, though its default settings struggle with small data on high core counts.
We observe that default Polars is fastest on all but one benchmarks.