Commits
Andy Grove authored and Andrew Lamb committed 4c48539c936
ARROW-10994: [Rust] [DataFusion] Add support for compression when writing Parquet files DataFusion changes in this PR: - `ExecutionContext.write_parquet` now accepts an optional Parquet `WriterProperties` so that calls can choose Parquet writer options, such as which compression format to use. - Improved error handling in case where output directory already exists Benchmark changes in this PR: - The TPC-H `convert` subcommand now accepts a compression format when writing Parquet files and it defauilts to Snappy - Progress information is output to stdout along with timings for better UX Closes #8978 from andygrove/tpch-convert-improvements Authored-by: Andy Grove <andygrove73@gmail.com> Signed-off-by: Andrew Lamb <andrew@nerdnetworks.org>