计算机科学
算法
可扩展性
推论
理论计算机科学
单位(环理论)
人工智能
代表(政治)
钥匙(锁)
特征(语言学)
集合(抽象数据类型)
素描
作者
Yonghao Chen,Jiaxiang Zou,Xingyu Chen,Chenxi Xu,Jingyu Guo,Xinyu Chen
出处
期刊:
日期:2026-06-01
卷期号:: 2520-2535
标识
DOI:10.1109/isca66397.2026.00176
摘要
Large Language Models (LLMs) have achieved remarkable success across a broad range of applications but impose extreme computational and memory demands due to their reliance on massive General Matrix-Matrix Multiplication (GEMM) operations. Quantization has emerged as a key approach to improve efficiency by reducing data precision; however, modern LLMs exhibit diverse sensitivities to quantization, requiring multiple precision settings. Existing hardware accelerators fail to efficiently support this diversity: fixed-function accelerators are limited to a few discrete formats, while bit-composable architectures suffer from quadratic resource scaling, leading to severe performance degradation at higher precision. We propose UniCore, a unified GEMM architecture that achieves both bit-width scalability and accuracy preservation through a hardware-software co-design. UniCore introduces Scalable FPMA (S-FPMA), the first composable FPMA primitive that fuses into different precisions using uniform adder slices, maintaining linear hardware scaling. To ensure numerical fidelity, UniCore integrates a lightweight format-conversion and dual-path compensation pipeline that corrects FPMA's structured approximation error. Complementing the architecture, DynFP, a distribution-adaptive low-bit floating-point format, improves representational accuracy for diverse LLM weight and activation distributions. UniCore delivers$\mathbf{1. 2 4} \times-\mathbf{3. 9 5} \times$higher area efficiency for W4A4/W4A8/W8A8 and up to 5.26× at W16A16 compared to prior composable-multiplier accelerators, while achieving the highest accuracy in nearly all configurations. UniCore is open-sourced at: https://github.com/CLab-HKUST-GZ/isca53-unicore
科研通智能强力驱动
Strongly Powered by AbleSci AI