Commits
Andy Grove authored 28bfd2bb0ef
ARROW-6101: [Rust] [DataFusion] Parallel execution of physical query plan This PR implements parallel query execution, with the ability to create a physical query plan from a logical plan, and call `ExecutionContext.collect()` to execute the plan and collect the results into a single vector. This currently only supports trivial projections against partitioned CSV files. I will create separate PRs to add the other operators (selection, limit, aggregation, etc). Closes #5111 from andygrove/ARROW-6101 and squashes the following commits: b820e6904 <Andy Grove> trigger build 0210c70f1 <Andy Grove> remove an unwrap d8ff02fd1 <Andy Grove> remove hard-coded batch size, remove comment, remove panic 21e646f50 <Andy Grove> test passes dd3cbe6eb <Andy Grove> format 104f3ad9b <Andy Grove> csv provider now supports partitioned csv files 20216bc61 <Andy Grove> realistic test (failing) 7ff8ab718 <Andy Grove> gmt 55150335c <Andy Grove> unit test works a292cce37 <Andy Grove> unit test (currently fails) 63c88d805 <Andy Grove> error handling 42566c364 <Andy Grove> implement collect() c69221785 <Andy Grove> rebase Authored-by: Andy Grove <andygrove73@gmail.com> Signed-off-by: Andy Grove <andygrove73@gmail.com>