科迪奇
计算机科学
功能(生物学)
并行计算
现场可编程门阵列
嵌入式系统
生物
进化生物学
作者
Omkar Kokane,Gopal Raut,Salim Ullah,Mukul Lokhande,Adam Teman,Akash S. Kumar,Santosh Kumar Vishvakarma
出处
期刊:IEEE Computer Society Annual Symposium on VLSI
[Institute of Electrical and Electronics Engineers]
日期:2025-07-06
卷期号:: 1-6
被引量:23
标识
DOI:10.1109/isvlsi65124.2025.11130218
摘要
A CORDIC-based configuration for the design of Activation Functions (AF) was previously suggested to accelerate ASIC hardware design for resource-constrained systems by providing functional reconfigurability. Since its introduction, this new approach for neural network acceleration has gained widespread popularity, influencing numerous designs for activation functions in both academic and commercial AI processors. In this retrospective analysis, we explore the foundational aspects of this initiative, summarize key developments over recent years, and introduce the DA-VINCI AF tailored for the evolving needs of AI applications. This new generation of dynamically configurable and precision-adjustable activation function cores promise greater adaptability for a range of activation functions in AI workloads, including Swish, SoftMax, SeLU, and GeLU, utilizing the Shift-and-Add CORDIC technique. The previously presented design has been optimized for MAC, Sigmoid, and Tanh functionalities and incorporated into ReLU AFs, culminating in an accumulative NEURIC compute unit. These enhancements position NEURIC as a fundamental component in the resourceefficient vector engine for the realization of AI accelerators that focus on DNNs, RNNs/LSTMs, and Transformers, achieving a quality of results (QoR) of $\mathbf{9 8. 5 \%}$.
科研通智能强力驱动
Strongly Powered by AbleSci AI