HPDC '14

ConCORD: Easily Exploiting Memory Content Redundancy through the Content-Aware Service Command

Lei Xia, Kyle Hale, Peter Dinda

Proceedings of the 23rd International Symposium on High-Performance Parallel and Distributed Computing, June 2014.

Abstract

We argue that memory content-tracking across the nodes of a parallel machine should be factored into a distinct platform service on top of which application services can be built. ConCORD is a proof-of-concept system that we have developed and evaluated to test this claim. Our core insight is that many application services can be described as a query over memory content. This insight leads to a core concept in ConCORD, the content-aware service command architecture, in which an application service is implemented as a parametrization of a single general query that ConCORD knows how to execute well. ConCORD dynamically adapts the execution of the query to the amount of redundancy available and other factors. We show that a complex application service (collective checkpointing) can be implemented in only hundreds of lines of code within ConCORD, while performing well.

BibTeX

@inproceedings{XIA:2014:CONCORD,
  author    = {Xia, Lei and Hale, Kyle and Dinda, Peter},
  title     = {ConCORD: Easily Exploiting Memory Content Redundancy through the Content-Aware Service Command},
  booktitle = {Proceedings of the 23rd International Symposium on High-Performance Parallel and Distributed Computing},
  series    = {HPDC '14},
  year      = {2014},
  month     = {June},
  pages     = {25–36},
  numpages  = {12},
  publisher = {Association for Computing Machinery},
  address   = {New York, NY, USA},
  location  = {Vancouver, BC, Canada},
  isbn      = {9781450327497},
  doi       = {10.1145/2600212.2600214},
  url       = {https://doi.org/10.1145/2600212.2600214},
  keywords  = {content sharing, hpc, memory deduplication, virtualization}
}

← All publications