Reducing DRAM Latency at Low Cost by Exploiting Heterogeneity

作者
Donghyuk Lee
出处
期刊: [Figshare (United Kingdom)]
被引量:35
标识
DOI:10.1184/r1/7449281.v1
摘要

In modern systems, DRAM-based main memory is signi cantly slower than the processor. Consequently, processors spend a long time waiting to access data from main memory, making the long main memory access latency one of the most critical bottlenecks to achieving high system performance. Unfortunately, the latency of DRAM has remained almost constant in the past decade. This is mainly because DRAM has been optimized for cost-per-bit, rather than access latency. As a result, DRAM latency is not reducing with technology scaling, and continues to be an important performance bottleneck in modern and future systems. This dissertation seeks to achieve low latency DRAM-based memory systems at low cost in three major directions. The key idea of these three major directions is to enable and ex- ploit latency heterogeneity in DRAM architecture. First, based on the observation that long bitlines in DRAM are one of the dominant sources of DRAM latency, we propose a new DRAM architecture, Tiered-Latency DRAM (TL-DRAM), which divides the long bitline into two shorter segments using an isolation transistor, allowing one segment to be accessed with reduced latency. Second, we propose a ne-grained DRAM latency reduction mechanism, Adaptive-Latency DRAM, which optimizes DRAM latency for the common operating conditions for individual DRAM module. We observe that DRAM manufacturers incorporate a very large timing margin as a provision against the worst-case operating conditions, which is accessing the slowest cell across all DRAM products with the worst latency at the highest temperature, even though such a slowest cell and such an operating condition are rare. Our mechanism dynamically optimizes DRAM latency to the current operating condition of the accessed DRAM module, thereby reliably improving system performance. Third, we observe that cells closer to the peripheral logic can be much faster than cells farther from the peripheral logic (a phenomenon we call architectural variation). Based on this observation, we propose a new technique, Architectural-Variation-Aware DRAM (AVA-DRAM), which reduces DRAM latency at low cost, by pro ling and identifying only the inherently slower regions in DRAM to dynamically determine the lowest latency DRAM can operate at without causing failures. This dissertation provides a detailed analysis of DRAM latency by using both circuit-level simulation with a detailed DRAM model and FPGA-based pro ling of real DRAM modules. Our latency analysis shows that our low latency DRAM mechanisms enable significant latency reductions, leading to large improvement in both system performance and energy e fficiency across a variety of workloads in our evaluated systems, while ensuring reliable DRAM operation.

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
明天见发布了新的文献求助10
刚刚
1秒前
阿居完成签到,获得积分10
1秒前
CC66发布了新的文献求助10
2秒前
研友_ndvWy8完成签到,获得积分10
2秒前
2秒前
Gavin发布了新的文献求助10
2秒前
2秒前
Orange完成签到,获得积分10
2秒前
汪汪糖完成签到 ,获得积分10
4秒前
阿居发布了新的文献求助10
7秒前
蒲勇兵完成签到 ,获得积分10
8秒前
lx完成签到,获得积分10
8秒前
Orange的应助被东莨菪碱采纳,获得10
8秒前
8秒前
猖狂战神发布了新的文献求助10
8秒前
莴苣米饭完成签到,获得积分10
9秒前
张志辉发布了新的文献求助10
9秒前
ZWJ完成签到 ,获得积分10
9秒前
9秒前
304完成签到,获得积分10
9秒前
ASYHJM完成签到,获得积分10
10秒前
Swan完成签到,获得积分10
10秒前
11秒前
Tao完成签到,获得积分10
12秒前
12秒前
勾真义完成签到,获得积分10
12秒前
12秒前
ssswww发布了新的文献求助10
12秒前
Monicadd完成签到 ,获得积分10
13秒前
304发布了新的文献求助10
14秒前
活泼惜蕊完成签到 ,获得积分10
14秒前
杨树完成签到 ,获得积分10
14秒前
麻辣鱿鱼徐完成签到,获得积分10
15秒前
温柔的吐司完成签到,获得积分10
15秒前
花花发布了新的文献求助10
16秒前
butterflycat完成签到,获得积分10
16秒前
正直小懒猪完成签到,获得积分10
16秒前
薛小飞完成签到 ,获得积分10
16秒前
可靠的安珊完成签到 ,获得积分10
17秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 2000
Sex, Aging, and Death in a Medieval Medical Compendium: Trinity College Cambridge MS R.14.52, Its Texts, Language, and Scribe 500
高分子基功能界面水蒸发材料与应用研究 500
外场增强的水汽发电研究 500
基于结构调控的功能化水诱导发电材料与器件研究 500
基于界面调控的高效湿气发电材料与器件研究 500
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8190478
求助须知:如何正确求助?哪些是违规求助? 9577686
关于积分的说明 21853808
捐赠科研通 7789496
什么是DOI,文献DOI怎么找? 3436407
关于科研通互助平台的介绍 2560235
邀请新用户注册赠送积分活动 2483054