现场可编程门阵列
计算机科学
变压器
块(置换群论)
嵌入式系统
并行计算
电气工程
工程类
数学
电压
几何学
出处
期刊:International Conference on Communications, Circuits and Systems
日期:2024-05-10
卷期号:: 18-23
被引量:3
标识
DOI:10.1109/icccas62034.2024.10651591
摘要
Recently, transformer models have been widely deployed in natural language processing and image processing. However, its superior performance comes with high amount of parameters and computations which make it difficult to deploy transformer models in resource limited devices. To reduce the computation cost of transformer models, in this paper, an improved network pruning method is proposed. In the proposed pruning method, the parameter matrix is decomposed into blocks of a specific size. Then, pruning is applied to each block so that the number of parameters remaining in each block is the same. To further reduce the memory requirement of the parameters, an efficient memory storage pattern for sparse parameters is also proposed in this paper. Finally, by combining the proposed methods, an energy efficient transformer accelerator architecture is proposed. The proposed accelerator is implemented in FPGA devices and implementation results show that the proposed design can significantly improve the speed performance and energy efficiency when compared with previous designs.
科研通智能强力驱动
Strongly Powered by AbleSci AI