Commits


Matt Topol authored and GitHub committed afe5514a3ab
GH-33466: [Go][Parquet] Add support for Dictionary arrays to pqarrow (#34342) ### Rationale for this change The Parquet package should properly handle dictionary array types to allow consumers to efficiently read/write dictionary encoded arrays for Dictionary encoded parquet files. ### What changes are included in this PR? Updates and fixes to allow Parquet read/write directly to/from dictionary arrays. Because it requires the `Unique` and `Take` compute functions, the dictionary handling requires go1.18+ just like the compute package does. Updates the schema to handle dictionary types when storing the arrow schema. This also adds some new methods to the `ColumnWriter` interface and the `BinaryRecordReader` for handling Dictionaries. ### Are these changes tested? Yes, unit tests are added in the change. * Closes: #33466 Lead-authored-by: Matt Topol <zotthewizard@gmail.com> Co-authored-by: Will Jones <willjones127@gmail.com> Signed-off-by: Matt Topol <zotthewizard@gmail.com>