SpikeSim: An End-to-End Compute-in-Memory Hardware Evaluation Tool for Benchmarking Spiking Neural Networks

计算机科学 尖峰神经网络 冯·诺依曼建筑 瓶颈 人工神经网络 并行计算 计算 计算机硬件 延迟(音频) 计算机体系结构 嵌入式系统 人工智能 算法 操作系统 电信
作者
Abhishek Moitra,Abhiroop Bhattacharjee,Runcong Kuang,Gokul Krishnan,Yu Cao,Priyadarshini Panda
出处
期刊:IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems [Institute of Electrical and Electronics Engineers]
卷期号:42 (11): 3815-3828 被引量:30
标识
DOI:10.1109/tcad.2023.3274918
摘要

Spiking neural networks (SNNs) are an active research domain toward energy-efficient machine intelligence. Compared to conventional artificial neural networks (ANNs), SNNs use temporal spike data and bio-plausible neuronal activation functions such as leaky-integrate fire/integrate fire (LIF/IF) for data processing. However, SNNs incur significant dot-product operations causing high memory and computation overhead in standard von-Neumann computing platforms. To this end, in-memory computing (IMC) architectures have been proposed to alleviate the "memory-wall bottleneck" prevalent in von-Neumann architectures. Although recent works have proposed IMC-based SNN hardware accelerators, the following key implementation aspects have been overlooked: 1) the adverse effects of crossbar nonideality on SNN performance due to repeated analog dot-product operations over multiple time-steps and 2) hardware overheads of essential SNN-specific components, such as the LIF/IF and data communication modules. To this end, we propose SpikeSim, a tool that can perform realistic performance, energy, latency and area evaluation of IMC-mapped SNNs. SpikeSim consists of a practical monolithic IMC architecture called SpikeFlow for mapping SNNs. Additionally, the nonideality computation engine (NICE) and energy–latency–area (ELA) engine performs hardware-realistic evaluation of SpikeFlow-mapped SNNs. Based on 65nm CMOS implementation and experiments on CIFAR10, CIFAR100 and TinyImagenet datasets, we find that the LIF/IF neuronal module has significant area contribution $(>11\%$ of the total hardware area). To this end, we propose SNN topological modifications that leads to $1.24\times $ and $10\times $ reduction in the neuronal module's area and the overall energy-delay-product value, respectively. Furthermore, in this work, we perform a holistic comparison between IMC implemented ANN and SNNs and conclude that lower number of time-steps are the key to achieve higher throughput and energy-efficiency for SNNs compared to 4-bit ANNs. The code repository for the SpikeSim tool is available at Github link.

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
hujun完成签到 ,获得积分10
刚刚
李先生完成签到 ,获得积分10
1秒前
孙雪源完成签到 ,获得积分10
1秒前
cici完成签到,获得积分10
1秒前
1秒前
等待的谷波完成签到 ,获得积分10
2秒前
JeKing完成签到,获得积分10
3秒前
rongrong12完成签到,获得积分10
4秒前
J_Man完成签到,获得积分10
5秒前
5秒前
maxiaole完成签到,获得积分10
5秒前
6秒前
7秒前
8秒前
XIA完成签到 ,获得积分10
8秒前
Dan完成签到,获得积分10
9秒前
没有名字完成签到 ,获得积分10
9秒前
敏感寒云完成签到,获得积分10
10秒前
jojo完成签到,获得积分10
10秒前
单纯半山完成签到,获得积分10
10秒前
11秒前
开飞机的天天完成签到,获得积分10
11秒前
清脆迎曼完成签到,获得积分10
11秒前
一盒火柴完成签到,获得积分10
11秒前
Frank完成签到 ,获得积分10
11秒前
arniu2008发布了新的文献求助10
12秒前
清风完成签到 ,获得积分0
13秒前
詹慧子发布了新的文献求助10
13秒前
lx应助叶子采纳,获得10
14秒前
007完成签到,获得积分10
15秒前
ppapp完成签到,获得积分10
17秒前
芯止谭轩完成签到,获得积分10
19秒前
Owen应助arniu2008采纳,获得10
20秒前
小小完成签到 ,获得积分10
21秒前
liyang完成签到,获得积分10
22秒前
24秒前
25秒前
myirwyo完成签到,获得积分10
25秒前
小蓝完成签到,获得积分10
27秒前
28秒前
高分求助中
Principles of Economics, 11th Edition 10000
University Physics with Modern Physics, 16th edition 10000
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
Arthritis and Related Conditions, An Issue of Orthopedic Clinics 1000
Development of a Bridge Weigh-In-Motion System: A technology to convert the bridge response to the passage of traffic into data on vehicle configurations, speeds, times of travel and weights 1000
ズームレンズの光学設計に関する研究 800
Fundamentals of Pharmaceutical and Biologics Regulations: A Global Perspective, Second Edition 700
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 工程类 有机化学 化学工程 生物化学 计算机科学 内科学 物理 复合材料 催化作用 细胞生物学 无机化学 光电子学 物理化学 电极 基因
热门帖子
关注 科研通微信公众号,转发送积分 7290862
求助须知:如何正确求助?哪些是违规求助? 8909923
关于积分的说明 18857666
捐赠科研通 6958043
什么是DOI,文献DOI怎么找? 3209179
关于科研通互助平台的介绍 2378976
邀请新用户注册赠送积分活动 2184921