Commits
François Saint-Jacques authored and Antoine Pitrou committed 20961b72cef
ARROW-5269: [C++][Archery] Mark relevant benchmarks as regression The goal of this change is to mark benchmarks candidate for automated regression checks. Some benchmarks were refactored for various reasons: - Code deduplication where needed - Uniform input size for benchmarks in the same suite, usually to minimize the effect of cache hierarchy. - Favor external repetitions over manual repetitions and mintime when possible. - Add cmake ARROW_BUILD_BENCHMARKS_REFERENCE to toggle reference benchmarks. - Remove default benchmark filter of `^Regression`. - Remove `BM_` prefix from benchmark names - Fixes and addons to `archery` to support the `--pdb` option for debugging and add support for benchmarks reported as `items_per_seconds`. - Adds `archery benchmark list` sub-command to list suites and benchmarks Author: François Saint-Jacques <fsaintjacques@gmail.com> Closes #4285 from fsaintjacques/ARROW-5269-regression-candidates and squashes the following commits: 83780304d <François Saint-Jacques> Address comments 4a570ab90 <François Saint-Jacques> Reformat a9ecffd98 <François Saint-Jacques> address comments d8e779aab <François Saint-Jacques> Reformat 8334c68f7 <François Saint-Jacques> Remove BM_ benchmark prefix 5cebe2c23 <François Saint-Jacques> Normalize benchmarks 908f05a5b <François Saint-Jacques> Change default repetitions to 10 instead of 20 ffe723f05 <François Saint-Jacques> Add `benchmark list` sub-command. e0876474b <François Saint-Jacques> Refactor JSON benchmarks a7b4f5f50 <François Saint-Jacques> Improve archery benchmark support bea76ed0e <François Saint-Jacques> Refactor csv benchmarks f207974c0 <François Saint-Jacques> Refactor CompareFilter benchmarks b7911df3d <François Saint-Jacques> Refactor Bitmap benchmarks 1b5135ebd <François Saint-Jacques> Refactor Builder benchmarks