Commits


Hatem Helal authored and Wes McKinney committed 532d4ba05a8
ARROW-1012: [C++] Configurable batch size for parquet RecordBatchReader This patch adds support for configuring the record batch size when reading a parquet file by adding a `batch_size` to `ArrowReaderProperties`. Author: Hatem Helal <hhelal@mathworks.com> Closes #4304 from hatemhelal/arrow-1012 and squashes the following commits: 9ed935374 <Hatem Helal> update todo comment to be a bit more precise 9f93da7e0 <Hatem Helal> rework existing RecordBatchReader test to cover the case where batch size is smaller than the row group 0e2162849 <Hatem Helal> use deque instead of list 108a5d775 <Hatem Helal> Change default bactch size to 64K and comment 159b03041 <Hatem Helal> fix appveyor windows failure: must cast size_t to int b45782e56 <Hatem Helal> Initial attempt at supporting a configurable batch size for parquet RecordBatchReader