Enhanced memory management for scalable MPI intra-node communication on many-core processor

Joong Yeon Cho, Hyun Wook Jin, Dukyun Nam

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

5 Scopus citations


As the number of cores installed in a single computing node drastically increases, the intra-node communication between parallel processes becomes more important. The parallel programming models, such as Message Passing Interface (MPI), internally perform memory-intensive operations for intra-node communication. Thus, to address the scalability issue on many-core processors, it is critical to exploit emerging memory features provided by the contemporary computer systems. For example, the latest many-core processors are equipped with a high-bandwidth on-package memory. Modern 64-bit processors also support a large page size (e.g., 2MB), which can significantly reduce the number of TLB misses. The on-package memory and the huge pages have considerable potential for improving the performance of intra-node communication. However, such features are not thoroughly investigated in terms of intranode communication in the literature. In this paper, we propose enhanced memory management schemes to efficiently utilize the on-package memory and provide support for huge pages. The proposed schemes can significantly reduce the data copy and memory mapping overheads in MPI intra-node communication. Our experimental results show that our implementation on MVAPICH2 can improve the bandwidth of point-to-point communication up to 373%, and can reduce the latency of collective communication by 79% on an Intel Xeon Phi Knights Landing (KNL) processor.

Original languageEnglish
Title of host publicationEuroMPI 2017 - Proceedings of the 24th European MPI Users� Group Meeting
PublisherAssociation for Computing Machinery
ISBN (Print)9781450348492
StatePublished - 25 Sep 2017
Event24th European MPI Users� Group Meeting, EuroMPI 2017 - Chicago, United States
Duration: 25 Sep 201728 Sep 2017

Publication series

NameACM International Conference Proceeding Series


Conference24th European MPI Users� Group Meeting, EuroMPI 2017
Country/TerritoryUnited States


  • Huge page
  • Intra-node communication
  • Many-core
  • MPI
  • On-package memory


Dive into the research topics of 'Enhanced memory management for scalable MPI intra-node communication on many-core processor'. Together they form a unique fingerprint.

Cite this