Public
  1. Public

arrow

Public

Commits

Benjamin KietzmanFrançois Saint-Jacques
0cd36fed6b3
Benjamin Kietzman authored and François Saint-Jacques committed 2ebe1034155
ARROW-9105: [C++][Dataset][Python] Pass an explicit schema to split_by_row_groups

This allows row group `predicate`s to reference fields not present in the fragment's physical schema (for example a virtual partition column). Also applies the fragment's partition expression to the predicate so *no* row groups will be yielded if the partition expression contradicts the predicate.

Closes #7438 from bkietz/9105-ParquetFileFragment-scann

Authored-by: Benjamin Kietzman <bengilgit@gmail.com>
Signed-off-by: François Saint-Jacques <fsaintjacques@gmail.com>