RR-Compound: RDMA-Fused gRPC for Low Latency and High Throughput With an Easy Interface

远程直接内存访问 计算机科学 吞吐量 接口(物质) 低延迟(资本市场) 延迟(音频) 并行计算 计算机硬件 操作系统 计算机网络 电信 气泡 最大气泡压力法 无线
作者
Liang Geng,Hao Wang,Jingsong Meng,Dayi Fan,Sami Ben-Romdhane,Hari Kadayam Pichumani,Vinay Phegade,X Zhang
出处
期刊:IEEE Transactions on Parallel and Distributed Systems [Institute of Electrical and Electronics Engineers]
卷期号:35 (8): 1488-1505
标识
DOI:10.1109/tpds.2024.3404394
摘要

Advanced data centers strive for high performance and throughput, which can be achieved through the desirable merits of Remote Procedure Call (RPC) programming model and the low latency of Remote Direct Memory Access (RDMA). However, despite the widespread availability of these software and hardware utilities, they have been utilized separately for their own applications in existing production systems for many years. Although researchers have attempted to develop RDMA-enabled RPC prototypes, they often face challenges such as API discrepancies and a lack of specific features for effective integration with major production software, rendering them incompatible. This industry R&D project aims to enhance the performance of gRPC, a widely utilized RPC framework in major companies, by integrating RDMA as an internal component. Our system solution, called, combines the simple user interface and other merits of gRPC with low latency for remote data accesses. RR-Compound is fully compatible with gRPC and can serve as a seamless replacement without altering existing applications. However, to achieve low latency, high throughput, and scalability for RR-Compound, several technical challenges in managing network connections and memory space utilization must be effectively addressed. To overcome the limitations of existing connection methods, we have developed a new method called BPEV that is independent of gRPC and applicable to all RDMA systems. We have also retained the asynchronous framework of gRPC, albeit with limited buffer space in RDMA memory management. In micro-benchmarks, RR-Compound outperforms mRPC - the state-of-the-art RPC framework for a large number of connections, achieving a 14.77% increase in throughput and a 42.55% reduction in latency. Subsequently, we compare RR-Compound with gRPC over IPoIB using two real-world applications: KV-Store and TensorFlow. RR-Compound achieves up to a 2.35x increase in throughput and reduces the average latency by 46.92%.

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
乐观小之发布了新的文献求助10
刚刚
1秒前
川一发布了新的文献求助10
1秒前
haokai409完成签到,获得积分10
2秒前
Maestro_S的应助被FENGHUI采纳,获得10
2秒前
dadaup发布了新的文献求助10
2秒前
殿书完成签到,获得积分10
3秒前
suijinicheng完成签到 ,获得积分10
3秒前
S01完成签到,获得积分10
3秒前
英姑的应助被yujuan采纳,获得10
3秒前
南渡完成签到,获得积分20
4秒前
莫1031完成签到,获得积分20
4秒前
豆子发布了新的文献求助10
5秒前
蛋堡发布了新的文献求助10
5秒前
5秒前
cdercder的应助被天天采纳,获得10
6秒前
所所的应助被科研通管家采纳,获得10
6秒前
小蘑菇的应助被科研通管家采纳,获得10
6秒前
阳光完成签到,获得积分10
6秒前
英姑的应助被科研通管家采纳,获得10
6秒前
在水一方的应助被科研通管家采纳,获得10
6秒前
6秒前
林森发布了新的文献求助10
6秒前
嘻嘻哈哈的应助被duwang采纳,获得10
7秒前
7秒前
天天向上的应助被科研通管家采纳,获得10
7秒前
华仔的应助被科研通管家采纳,获得10
7秒前
传奇3的应助被科研通管家采纳,获得10
7秒前
CipherSage的应助被科研通管家采纳,获得10
7秒前
李健的应助被科研通管家采纳,获得10
7秒前
小二郎的应助被张宝采纳,获得10
7秒前
7秒前
思源的应助被byemaxf采纳,获得10
7秒前
共享精神的应助被科研通管家采纳,获得10
7秒前
Orange的应助被科研通管家采纳,获得10
8秒前
勤劳的斑马完成签到,获得积分10
8秒前
敏感寻真发布了新的文献求助10
8秒前
传奇3的应助被科研通管家采纳,获得10
8秒前
8秒前
8秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 1700
The World Atlas of Wine 9th edition 1000
奈特基础组织学:配套组织病理学(第4版)(Netter's Essential Histology With Correlated Histopathology) 800
John McDowells Bildungstheorie 800
八旗制度の研究 600
plantTFDB 508
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8167935
求助须知:如何正确求助?哪些是违规求助? 9560906
关于积分的说明 21758387
捐赠科研通 7759046
什么是DOI,文献DOI怎么找? 3429786
关于科研通互助平台的介绍 2553707
邀请新用户注册赠送积分活动 2474360