G-Anomaly: A Pyramid Graph Transformer-Based Vision-Language Model for General Industrial Anomaly Detection

Visual-language alignment is crucial for enhancing the domain adaptability of industrial anomaly detection models. However, the existing methods overlook the importance of structured image representation, fail to further distinguish topological differences between anomalies and the inherent textures of products, which reduces the accuracy of semantic matching. To address this problem, we propose a novel industrial anomaly detection model G-Anomaly, to preserve the topological structure of the sample images and further enhance the model’s domain adaptability. We designed Pyramid Graph Transformer as a visual encoder to extract multi-scale visual features, which can directly preserve the structural relationships between different regions of the image, and also optimize the over-smoothing issue present in deep graph networks, thereby retaining the distinguishability of anomalous nodes. Additionally, we design a Multi-level Domain Adapter that ensures semantic consistency of anomalous features across different scales and contexts by performing visual-language matching at various resolutions and levels of abstraction. This enhances the model’s domain adaptability for anomaly detection for a wide range of industrial products. We collect and craft an actual solar panel dataset PV_actual AD, and conduct extensive experiments on the public dataset MVTec AD as well as the actual solar panel dataset PV_actual AD. This has demonstrated that G-Anomaly not only performs well in standard testing environments but also exhibits robustness and domain adaptability for anomaly detection tasks in real-world scenarios.