Public
  1. Public

arrow

Public

Commits

Anurag KhandelwalPhilipp Moritz
012f77a9688
Anurag Khandelwal authored and Philipp Moritz committed 73792817a03
ARROW-4422: [Plasma] Enforce memory limit in plasma, rather than relying on dlmalloc_set_footprint_limit

https://issues.apache.org/jira/browse/ARROW-4422

This implementation imposes memory limit at Plasma by tracking the number of bytes allocated and freed using malloc and free calls. Whenever the allocation reaches the set limit, we fail any subsequent allocations (by returning NULL from malloc). This allows Plasma to not be tied to dlmalloc, and also provides more accurate tracking of memory allocation/capacity.

cc @pcmoritz

Author: Anurag Khandelwal <anuragk@berkeley.edu>

Closes #3526 from anuragkh/plasma_track_memory_use and squashes the following commits:

182e8a401 <Anurag Khandelwal> Replace dlmalloc calls with PlasmaAllocator, which internally calls dlmalloc