期刊: [Institute of Electrical and Electronics Engineers] 日期:2025-07-12卷期号:: 1-7
标识
DOI:10.1109/indin64977.2025.11278971
摘要
As industrial equipment becomes increasingly complex and intelligent, fault diagnosis (FD) technology has emerged as a critical means to ensure system reliability and safety, spurring the development of various real-time online monitoring techniques. Traditional fault diagnosis methods primarily rely on single data sources and specific algorithms, which makes it challenging to effectively integrate the multimodal data captured by diverse sensors and often overlooks the vital role of human expertise in the diagnostic process. By leveraging a universal fault diagnosis framework that combines Large Language Models (LLMs) with multimodal data, existing methods can be seamlessly integrated. LLMs possess powerful capabilities in natural language understanding, knowledge integration, and reasoning, enabling them to analyze text, images, signals, and other types of multimodal information to facilitate zero-shot and few-shot knowledge reasoning and fault diagnosis. This paper systematically reviews the development of LLM- and multimodal data-based fault diagnosis technologies, outlines key techniques such as data-driven processing, feature extraction, and feature fusion within LLM frameworks, and analyzes the technological advancements fostered by these methods. It also summarizes the advantages and limitations of this approach in fault diagnosis and health state assessment, and offers an outlook on the future trends and challenges of applying LLMs in multimodal fault diagnosis. The aim is to provide technical guidance for researchers and engineers, thereby accelerating the innovation and application of intelligent fault diagnosis technologies.