D-RDMALib: InfiniBand-based RDMA Library for Distributed Cluster Applications

RDMA (Remote Direct Memory Access) is a recent communication protocol that allows for the maximum utilization of the performance of InfiniBand, a high-speed network device based on Data Processing Units (DPUs). However, the existing RDMA development method incurs a high implementation complexity, which makes it difficult to apply to a multi-node environment. To solve these problems, we propose D-RDMALib, an efficient and easy-to-use RDMA library suitable for distributed cluster environments. As an effective development tool, D-RDMALib can reduce the implementation difficulty of applying RDMA to distributed multinode environments. It also improves the accessibility of InfiniBand and RDMA technologies with high entry barriers. In this paper, we demonstrate the efficiency of D-RDMALib by 1) verifying the successful operation of many-to-many communication in distributed nodes, and 2) evaluating the performance by implementing PageRank-based on DRDMALib. We believe that our work is a novel technique that can be easily applied to existing distributed processing environments as well as to emerging ultra-high-speed in-network technologies such as Quantum InfiniBand.