Public
  1. Public

arrow

Public

Commits

Mike SeddonAndrew Lamb
c490abda696
Mike Seddon authored and Andrew Lamb committed 8a134013494
ARROW-10783: [Rust][DataFusion] Implement Statistics for Parquet TableProvider

This is an implementation of Statistics for the Parquet datasource as this PR seems to have gone quiet: https://github.com/apache/arrow/pull/8860

This PR exposes the ParquetMetaData produced by the file reader as even though initially we only consume `row_count` and `total_byte_size` there is column level metadata that may be very useful in future for potentially large performance gains.

Closes #8944 from seddonm1/parquet-statistics

Authored-by: Mike Seddon <seddonm1@gmail.com>
Signed-off-by: Andrew Lamb <andrew@nerdnetworks.org>