神经形态工程学
计算机科学
尖峰神经网络
计算
人工神经网络
人工智能
记忆电阻器
能源消耗
等级制度
编码(内存)
计算机体系结构
突触重量
任务(项目管理)
延迟(音频)
非常规计算
人类视觉系统模型
MNIST数据库
低延迟(资本市场)
能量(信号处理)
高效能源利用
计算机硬件
内存层次结构
机器视觉
神经计算模型
嵌入式系统
计算机视觉
视觉对象识别的认知神经科学
作者
Juan Wen,Le Zhang,Shuai Bin Hua,Pu Li Gan,Bei Zhang,Ben Ye,Xin Guo
摘要
ABSTRACT The integration of sensing, memory, and computation into a unified hardware platform is crucial for energy‐efficient neuromorphic vision at the edge. However, it remains challenging due to the lack of complete hardware‐level implementations. Inspired by the retina‐to‐cortex hierarchy of the biological visual system, we propose a fully hardware‐implemented neuromorphic visual system based on single‐layer memristive spiking neural network that seamlessly integrates these three functions. In this architecture, Pt/NbO x N y /TiN‐based memristive visual neurons directly serve as input neurons, encoding light intensity and colour into spikes, interconnected Pt/TaO y /TaO x /Pt‐based memristive synaptic array performs computing in memory following precise weight mapping via a closed‐loop training module, while Pt/NbO x N y /TiN‐based memristive output neurons implement leaky integrate‐and‐fire dynamics to enable tunable computation and recognition. This highly integrated, fully analog architecture eliminates the need for buffer units and analog‐to‐digital∖ digital‐to‐analog converters, thereby reducing system latency by an order of magnitude and lowering energy consumption by 26.7%. As a proof of concept, the system demonstrates real‐time obstacle avoidance in an autonomous driving task without requiring frame‐based image storage or digital post‐processing. This work establishes a scalable, low‐latency, low‐energy, and fully hardware‐integrated paradigm for real‐time neuromorphic vision, advancing practical edge‐deployed intelligent sensing systems.
科研通智能强力驱动
Strongly Powered by AbleSci AI