Commits
Fabian Höring authored and Antoine Pitrou committed e8e4ca78f4b
ARROW-7309: [Python] Support HDFS federation viewfs - libhdfs already supports injecting the scheme and will automatically resolve federation in `fs = FileSystem#get(URI, conf, ugi)` - works with Hadoop 2/3 see: https://github.com/apache/hadoop/blob/trunk/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfs/hdfs.c#L770 https://github.com/apache/hadoop/blob/trunk/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfs/hdfs.c#L637 Closes #5957 from fhoering/support_viewfs and squashes the following commits: 31241f917 <Antoine Pitrou> Only display libhdfs3 warning if viewfs is requested 0c66726e4 <Fabian Höring> Fix linter 5177cc67c <Fabian Höring> Add warning if viewfs is used for hdfs3 driver a5b871ab9 <Fabian Höring> fix test test_fs 1e086aa97 <Fabian Höring> Add comment & rename method ConfigureHdfs3Driver 7534247fe <Fabian Höring> Add viewfs unit test for HdfsOptions::FromUri 969a28f8d <Fabian Höring> Fix test b3fb4d076 <Fabian Höring> Remove space 2c559b740 <Fabian Höring> Fix linter ffeb6584a <Fabian Höring> Fix test b318455cb <Fabian Höring> ARROW-7309: Add viewfs support to c++ impl FileSystemFromUri f3180fc88 <Fabian Höring> ARROW-7309: Change back default port for hdfs driver to 0 bae055e08 <Fabian Höring> ARROW-7309: Support HDFS federation viewfs in resolve_filesystem_and_path Lead-authored-by: Fabian Höring <f.horing@criteo.com> Co-authored-by: Antoine Pitrou <antoine@python.org> Signed-off-by: Antoine Pitrou <antoine@python.org>