Analyzing the tradeoff between throughput and latency in multicore scalable in-memory database systems

Hitoshi Mitake, Hiroshi Yamada, Tatsuo Nakajima

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    1 Citation (Scopus)

    Abstract

    In this paper, we present a tradeoff between throughput and latency in multicore scalable in-memory database systems by showing the results of a performance evaluation and analysis of Masstree, a state-of-the-art multicore scalable data structure that forms the foundation of a variety of multicore scalable database systems. The key technique to make Masstree scalable is an advanced concurrency control technique. Such a technique reduces cache line contention between cores and contributes to high throughput and scalability. However, surprisingly, the worst case latency of the Masstree-based key-value storage system was more than 10 times larger than the score of the memcached system. To detect the main source of the high latency spikes, we analyzed the concurrency control techniques of Masstree. As a result, we found that read-copy update (RCU), an important technique that enables scalability in Masstree, becomes the dominant factor in the high latency spikes. We present a straightforward approach to resolve the latency spikes. In addition, we also show the limitation of the straightforward approach and possible future directions of essential solutions.

    Original languageEnglish
    Title of host publicationProceedings of the 7th ACM SIGOPS Asia-Pacific Workshop on Systems, APSys 2016
    PublisherAssociation for Computing Machinery, Inc
    ISBN (Electronic)9781450342650
    DOIs
    Publication statusPublished - 2016 Aug 4
    Event7th ACM SIGOPS Asia-Pacific Workshop on Systems, APSys 2016 - Hong Kong, China
    Duration: 2016 Aug 42016 Aug 5

    Other

    Other7th ACM SIGOPS Asia-Pacific Workshop on Systems, APSys 2016
    CountryChina
    CityHong Kong
    Period16/8/416/8/5

    ASJC Scopus subject areas

    • Computer Networks and Communications
    • Hardware and Architecture

    Fingerprint Dive into the research topics of 'Analyzing the tradeoff between throughput and latency in multicore scalable in-memory database systems'. Together they form a unique fingerprint.

  • Cite this

    Mitake, H., Yamada, H., & Nakajima, T. (2016). Analyzing the tradeoff between throughput and latency in multicore scalable in-memory database systems. In Proceedings of the 7th ACM SIGOPS Asia-Pacific Workshop on Systems, APSys 2016 [2967361] Association for Computing Machinery, Inc. https://doi.org/10.1145/2967360.2967361