Looking into the Peak Memory Consumption of Epoch-Based Reclamation in Scalable in-Memory Database Systems

Hitoshi Mitake, Hiroshi Yamada, Tatsuo Nakajima

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Deferred memory reclamation is an essential mechanism of scalable in-memory database management systems (DBMSs) that releases stale objects asynchronously to free operations. Modern scalable in-memory DBMSs commonly employ a deferred reclamation mechanism named epoch-based reclamation (EBR). However, no existing research has studied the EBR’s trade-off between performance improvements and memory consumption; its peak memory consumption makes capacity planning difficult and sometimes causes disruptive performance degradation. We argue that gracefully controlling the peak memory usage is a key to achieving stable throughput and latency of scalable EBR-based in-memory DBMSs. This paper conducts a quantitative analysis and evaluation of a representative EBR-based DBMS, Silo, from the viewpoint of memory management. Our evaluation reveals that the integration of conventional solutions fails to achieve stable performance with lower memory utilization, and Glasstree-based Silo achieves a 20% higher throughput, latencies characterized by an 81% lower standard deviation, and 34% lower peak memory usage than Masstree-based Silo even under read-majority workloads.

Original languageEnglish
Title of host publicationDatabase and Expert Systems Applications - 30th International Conference, DEXA 2019, Proceedings
EditorsSven Hartmann, Josef Küng, Gabriele Anderst-Kotsis, Ismail Khalil, Sharma Chakravarthy, A Min Tjoa
PublisherSpringer
Pages3-18
Number of pages16
ISBN (Print)9783030276171
DOIs
Publication statusPublished - 2019
Event30th International Conference on Database and Expert Systems Applications, DEXA 2019 - Linz, Austria
Duration: 2019 Aug 262019 Aug 29

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11707 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference30th International Conference on Database and Expert Systems Applications, DEXA 2019
CountryAustria
CityLinz
Period19/8/2619/8/29

Keywords

  • Epoch-based reclamation
  • In-memory database
  • Index tree structure
  • Multicore scalability

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint Dive into the research topics of 'Looking into the Peak Memory Consumption of Epoch-Based Reclamation in Scalable in-Memory Database Systems'. Together they form a unique fingerprint.

  • Cite this

    Mitake, H., Yamada, H., & Nakajima, T. (2019). Looking into the Peak Memory Consumption of Epoch-Based Reclamation in Scalable in-Memory Database Systems. In S. Hartmann, J. Küng, G. Anderst-Kotsis, I. Khalil, S. Chakravarthy, & A. M. Tjoa (Eds.), Database and Expert Systems Applications - 30th International Conference, DEXA 2019, Proceedings (pp. 3-18). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11707 LNCS). Springer. https://doi.org/10.1007/978-3-030-27618-8_1