Public
  1. Public

arrow

Public

Commits

Qingping HouAndrew Lamb
cd56f5c0b6f
Qingping Hou authored and Andrew Lamb committed 3deae8dd50d
ARROW-10842 [Rust] decouple IO from json reader, fix crash during json schema inference with invalid json

Other related changes:

 * reuse the same IO code between schema inference and record batch reader.
 * reuse string buffer to avoid repeatitive memory allocation
 * ignore new lines when reading json records
 * avoid hard crash during JSON schema inference caused by invalid json

Closes #8867 from houqp/qp_json

Authored-by: Qingping Hou <dave2008713@gmail.com>
Signed-off-by: Andrew Lamb <andrew@nerdnetworks.org>