Softmax函数
现场可编程门阵列
计算机科学
规范化(社会学)
延迟(音频)
硬件加速
嵌入式系统
计算机硬件
并行计算
人工智能
人工神经网络
人类学
电信
社会学
作者
Seongho Jeong,Minseok Seo,Xuan Truong Nguyen,Hyuk‐Jae Lee
出处
期刊:
日期:2023-10-23
卷期号:: 1-3
被引量:10
标识
DOI:10.1109/icce-asia59966.2023.10326397
摘要
Vector operations such as GELU, softmax, and layer normalization are essential for transformers, but generally consume long latency on general-purpose CPU and GPU due to their low arithmetic intensities and high nonlinearity. In this study, we propose a low-latency FPGA-based architecture for accelerating the vector operations. Specifically, the proposed design includes processing elements for micro-instructions and a controller that decomposes and executes vector operations into in-order low-level instructions effectively. Experiments show that an FPGA implementation of the proposed design achieves a latency of 1.31us for softmax and 3.76us for layer normalization, while consuming 385 DSPs, 16 BRAMs, 71k FFs, and 57k. LUTs.
科研通智能强力驱动
Strongly Powered by AbleSci AI