Commits
Andy Grove authored 4e06c1e98eb
ARROW-9711: [Rust] Add new benchmark derived from TPC-H This PR builds on https://github.com/apache/arrow/pull/7951. Adds a new benchmark derived from TPC-H. I have been able to run this with a 100GB data set on my desktop and performance is about the same as Apache Spark running in local mode with the same thread count (24). ``` +--------------+--------------+-----------------+----------------------+--------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------+--------------------+----------------------+----------------------+-----------------+ | l_returnflag | l_linestatus | sum(l_quantity) | sum(l_extendedprice) | sum(l_extendedprice Multiply CAST(Int64(1) as Float64) Minus l_discount) | sum(l_extendedprice Multiply CAST(Int64(1) as Float64) Minus l_discount Multiply CAST(Int64(1) as Float64) Plus l_tax) | avg(l_quantity) | avg(l_extendedprice) | avg(l_discount) | count(UInt8(1)) | +--------------+--------------+-----------------+----------------------+--------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------+--------------------+----------------------+----------------------+-----------------+ | A | F | 3775127758 | 5660776097194.464 | 5377736398183.935 | 5592847429515.93 | 25.49937060623502 | 38236.11838745711 | 0.05000224145223291 | 148047881 | | N | F | 98553062 | 147771098385.98004 | 140384965965.03473 | 145999793032.77594 | 25.501475096542002 | 38237.03209968505 | 0.0499850931498342 | 3864590 | | N | O | 7651423419 | 11473321691083.244 | 10899667121317.215 | 11335664103186.313 | 25.499799813085986 | 38236.99077003657 | 0.04999757591275955 | 300058170 | | R | F | 3775724970 | 5661603032745.35 | 5378513563915.415 | 5593662252666.921 | 25.500067651651772 | 38236.70005754084 | 0.050001305269911714 | 148067261 | +--------------+--------------+-----------------+----------------------+--------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------+--------------------+----------------------+----------------------+-----------------+ Query 1 iteration 2 took 21004 ms ``` Closes #7946 from andygrove/rust-tpch Authored-by: Andy Grove <andygrove73@gmail.com> Signed-off-by: Andy Grove <andygrove73@gmail.com>