Commits
Emilio Lahr-Vivaz authored and Wes McKinney committed 49f666e7402
ARROW-542: Adding dictionary encoding to FileWriter WIP for comments Author: Emilio Lahr-Vivaz <elahrvivaz@ccri.com> Author: Wes McKinney <wes.mckinney@twosigma.com> Closes #334 from elahrvivaz/ARROW-542 and squashes the following commits: 5339730 [Emilio Lahr-Vivaz] fixing bitvector load of value count, adding struct integration test 00d78d3 [Emilio Lahr-Vivaz] fixing set bit validity value in NullableMapVector load 1679934 [Emilio Lahr-Vivaz] cleaning up license 70639e0 [Emilio Lahr-Vivaz] restoring vector loader test bde4eee [Wes McKinney] Handle 0-length message indicator for EOS in C++ StreamReader a24854b [Emilio Lahr-Vivaz] fixing StreamToFile conversion 2ee7cfb [Emilio Lahr-Vivaz] fixing FileToStream conversion adec200 [Emilio Lahr-Vivaz] making arrow magic static, cleanup 8366288 [Emilio Lahr-Vivaz] making magic array private 127937f [Emilio Lahr-Vivaz] removing qualifier for magic db9a007 [Emilio Lahr-Vivaz] adding dictionary tests to echo server 95c7b2a [Emilio Lahr-Vivaz] cleanup 45caa02 [Emilio Lahr-Vivaz] reverting basewriter dictionary methods 682db6f [Emilio Lahr-Vivaz] cleanup a1508b9 [Emilio Lahr-Vivaz] removing dictionary vector method (instead use field.dictionary) 43c28af [Emilio Lahr-Vivaz] adding test for nested dictionary encoded list 92a1e6f [Emilio Lahr-Vivaz] fixing imports e567564 [Emilio Lahr-Vivaz] adding field size check in vectorschemaroot 568fda5 [Emilio Lahr-Vivaz] imports, formatting 363308e [Emilio Lahr-Vivaz] fixing tests 2f69be1 [Emilio Lahr-Vivaz] not passing around dictionary vectors with dictionary fields, adding dictionary encoding to fields, restoring vector loader/unloader e5c8e02 [Emilio Lahr-Vivaz] Merging dictionary unloader/loader with arrow writer/reader Creating base class for stream/file writer Creating base class with visitors for arrow messages Indentation fixes Other cleanup d095f3f [Emilio Lahr-Vivaz] ARROW-542: Adding dictionary encoding to file and stream writing