Data Convection

作者
Soheil Khadirsharbiyani,Jagadish Kotra,Karthik Rao,Mahmut Kandemir
出处
期刊:Proceedings of the ACM on measurement and analysis of computing systems [Association for Computing Machinery]
卷期号:6 (1): 1-25 被引量:3
标识
DOI:10.1145/3508027
摘要

Stacked DRAMs have been studied, evaluated in multiple scenarios, and even productized in the last decade. The large available bandwidth they offer make them an attractive choice, particularly, in high-performance computing (HPC) environments. Consequently, many prior research efforts have studied and evaluated 3D stacked DRAM-based designs. Despite offering high bandwidth, stacked DRAMs are severely constrained by the overall memory capacity offered. In this paper, we study and evaluate integrating stacked DRAM on top of a GPU in a 3D manner which in tandem with the 2.5D stacked DRAM increases the capacity and the bandwidth without increasing the package size. This integration of 3D stacked DRAMs aids in satisfying the capacity requirements of emerging workloads like deep learning. Though this vertical 3D integration of stacked DRAMs also increases the total available bandwidth, we observe that the bandwidth offered by these 3D stacked DRAMs is severely limited by the heat generated on the GPU. Based on our experiments on a cycle-level simulator, we make a key observation that the sections of the 3D stacked DRAM that are closer to the GPU have lower retention-times compared to the farther layers of stacked DRAM. This thermal-induced variable retention-times causes certain sections of 3D stacked DRAM to be refreshed more frequently compared to the others, thereby resulting in thermal-induced NUMA paradigms. To alleviate such thermal-induced NUMA behavior, we propose and experimentally evaluate three different incarnations of Data Convection, i.e., Intra-layer, Inter-layer, and Intra + Inter-layer, that aim at placing the most-frequently accessed data in a thermal-induced retention-aware fashion, taking into account both bank-level and channel-level parallelism. Our evaluations on a cycle-level GPU simulator indicate that, in a multi-application scenario, our Intra-layer, Inter-layer and Intra + Inter-layer algorithms improve the overall performance by 1.8%, 11.7%, and 14.4%, respectively, over a baseline that already encompasses 3D+2.5D stacked DRAMs.

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
aifeidence完成签到 ,获得积分10
刚刚
盈虚者完成签到,获得积分10
刚刚
花花衬衫发布了新的文献求助10
1秒前
1秒前
achilles发布了新的文献求助10
1秒前
2秒前
香蕉觅云的应助被鹿吖鹿采纳,获得10
2秒前
2秒前
Jingyi完成签到 ,获得积分10
2秒前
lrr发布了新的文献求助10
3秒前
3秒前
孤独的芒果完成签到,获得积分10
3秒前
喜悦凝旋发布了新的文献求助20
4秒前
随心完成签到,获得积分10
4秒前
4秒前
5秒前
我是老大的应助被123采纳,获得10
5秒前
6秒前
金玉完成签到,获得积分10
6秒前
香蕉觅云的应助被小党采纳,获得10
7秒前
热心网友123完成签到,获得积分10
7秒前
7秒前
wei完成签到,获得积分10
8秒前
要减肥的11完成签到 ,获得积分20
8秒前
8秒前
不想吃饭发布了新的文献求助50
8秒前
彭于晏的应助被邓木采纳,获得10
8秒前
liwenqiang完成签到,获得积分10
8秒前
8秒前
8秒前
9秒前
维C续航中发布了新的文献求助10
10秒前
Hongrui_Guo完成签到 ,获得积分10
11秒前
11秒前
11秒前
11秒前
西贝完成签到,获得积分20
11秒前
shengji完成签到,获得积分10
11秒前
xyy完成签到 ,获得积分10
12秒前
jasmine完成签到,获得积分10
12秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 1700
The World Atlas of Wine 9th edition 1000
奈特基础组织学:配套组织病理学(第4版)(Netter's Essential Histology With Correlated Histopathology) 800
John McDowells Bildungstheorie 800
Social Psychology in the Real World 600
八旗制度の研究 600
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8181155
求助须知:如何正确求助?哪些是违规求助? 9571140
关于积分的说明 21816740
捐赠科研通 7777528
什么是DOI,文献DOI怎么找? 3433436
关于科研通互助平台的介绍 2557664
邀请新用户注册赠送积分活动 2479482