计算机科学
建筑
计算机体系结构
嵌入式系统
比例(比率)
服务(商务)
业务
物理
量子力学
艺术
视觉艺术
营销
作者
Zheng Ming Xu,Dehao Kong,Jiaxin Liu,Jinxi Li,Jialin Hou,Xu Dai,Chao Li,Shaojun Wei,Yang Hu,Shouyi Yin
出处
期刊:
日期:2025-06-20
卷期号:: 1-17
被引量:36
标识
DOI:10.1145/3695053.3731101
摘要
The deployment of large language models (LLMs) imposes significant demands on computing, memory, and communication resources.Wafer-scale technology enables the high-density integration of multiple single-die chips with high-speed Die-to-Die (D2D) interconnections, presenting a promising solution to meet these demands arising from LLMs.However, given the limited wafer area, a trade-off needs to be made among computing, storage, and communication resources.Maximizing the benefits and minimizing the drawbacks of wafer-scale technology is crucial for enhancing the performance of LLM service systems, which poses challenges to both architecture and scheduling.Unfortunately, existing methods cannot effectively address these challenges.To bridge the gap, we propose WSC-LLM, an architecture and scheduling co-exploration framework.We first define a highly configurable general hardware template designed to explore optimal architectural parameters for wafer-scale chips.Based on it, we
科研通智能强力驱动
Strongly Powered by AbleSci AI