Public
  1. Public

arrow

Public

Commits

Raúl CumplidoAntoine Pitrou
893faa741f3
Raúl Cumplido authored and Antoine Pitrou committed 37c3bd00f81
ARROW-16436: [C++][Python] Datasets should not ignore CSV autogenerate_column_names

The added test failed previously because the `autogenerate_column_names` was ignored:
```
E   pyarrow.lib.ArrowInvalid: Error creating dataset. Could not read schema from '/tmp/pytest-of/pytest-15/test_csv_format_options_genera1/test.csv': Could not open CSV input source '/tmp/pytest-of/pytest-15/test_csv_format_options_genera1/test.csv': Invalid: CSV file contained multiple columns named 1. Is this a 'csv' file?
```
Use the same approach we use on `GenerateColumnNames` here https://github.com/apache/arrow/blob/master/cpp/src/arrow/csv/reader.cc#L637-L646

Closes #13064 from raulcd/ARROW-16436

Authored-by: Raúl Cumplido <raulcumplido@gmail.com>
Signed-off-by: Antoine Pitrou <antoine@python.org>