Commits
François Saint-Jacques authored and Krisztián Szűcs committed c3c8e763007
ARROW-5071: [Archery] Implement running benchmark suite - Implements the `archery benchmark run` sub-command that performs a single run without comparing to another run. This is the main basic blocks to run a benchmark and publish the result to a database, e.g. codespeed and/or custom db. Push is not provided in this PR. - Implements serializing/de-serializing the result of a run in JSON. - Improved the `from_rev_or_path` method to also support the previous point json output. Thus, you can compare a mixture of commit(s)/build(s)/run's output(s). Effectively adding support for comparing on cached results of a run. - Implements redirecting the output to a named file via `--output`, `-` means stdout (the defaults). - Improved the `GoogleBenchmarkRunner` to output partial results to stdout for progress feedback. Author: François Saint-Jacques <fsaintjacques@gmail.com> Closes #4249 from fsaintjacques/ARROW-5071-benchmark-run and squashes the following commits: 1ca0aa9bf <François Saint-Jacques> Add documentation 166d4fc73 <François Saint-Jacques> Implement storing benchmark result offline 257e1e2f9 <François Saint-Jacques> Implement archery benchmark run 734018597 <François Saint-Jacques> Add benchmark-diff --output option b304f7026 <François Saint-Jacques> Run benchmark with feedback to stdout