Commits
Anurag Khandelwal authored and Uwe L. Korn committed 5a7cec45878
ARROW-4294: [C++] [Plasma] Add support for evicting Plasma objects to external store https://issues.apache.org/jira/browse/ARROW-4294 Note: this PR was previously at https://github.com/apache/arrow/pull/3432, which was closed since its commit history was broken. Currently, when Plasma needs storage space for additional objects, it evicts objects by deleting them from the Plasma store. This is a problem when it isn't possible to reconstruct the object or reconstructing it is expensive. This patch adds support for a pluggable external store that Plasma can evict objects to when it runs out of memory. Author: Anurag Khandelwal <anuragk@berkeley.edu> Author: Philipp Moritz <pcmoritz@gmail.com> Closes #3482 from anuragkh/plasma_evict_to_external_store and squashes the following commits: 631671561 <Philipp Moritz> remove external store worker, simplify interface 6fbc55b08 <Anurag Khandelwal> Revert "Add an eviction buffer to allow asynchronous evictions" 4f2c02ce3 <Anurag Khandelwal> Revert "Minor fix" 1bc1dbed4 <Anurag Khandelwal> Revert "format fix" 7b662bee4 <Anurag Khandelwal> Revert "Remove timeout for external store test tearDown" 25663df30 <Anurag Khandelwal> Remove timeout for external store test tearDown 7945cc951 <Anurag Khandelwal> format fix 0d7263936 <Anurag Khandelwal> Minor fix 957efb5f0 <Anurag Khandelwal> Add an eviction buffer to allow asynchronous evictions 896d895bd <Anurag Khandelwal> Fixes 7ae486794 <Anurag Khandelwal> Merge branch 'master' into plasma_evict_to_external_store 1af2f8bce <Anurag Khandelwal> Fix cpplint issues 04e173085 <Anurag Khandelwal> Merge branch 'master' into plasma_evict_to_external_store 301e575ea <Anurag Khandelwal> Fix uses of ARROW_CHECK_OK/ARROW_CHECK 69a56abcc <Anurag Khandelwal> Fix documentation errrors c19c5767d <Anurag Khandelwal> Add documentation for notify flag f3fad8086 <Anurag Khandelwal> Fix external store worker intialization 9081596c4 <Anurag Khandelwal> Clean up formatting issues f5cc95c72 <Anurag Khandelwal> Add lint exclusion for external_store_worker, since it uses mutex ffd1f0e6c <Anurag Khandelwal> Extend plasma eviction changes to python module 8afc9fb2f <Anurag Khandelwal> Kill only the plasma_store_server that we started be315677b <Anurag Khandelwal> Add test for testing evictions/unevictions a43445aee <Anurag Khandelwal> Update serialization test 58a995318 <Anurag Khandelwal> Add support for evicting/un-evicting Plasma objects to/from external store