计算机科学
领域(数学分析)
领域知识
知识管理
数学
数学分析
作者
Chun Man Chan,Xiaowen Guo,Peter Kok-Yiu Wong,Jeff Chak Fu Chan,Jack C.P. Cheng,Ppy Leung,Xingyu Tao
出处
期刊:Kalpa publications in computing
日期:2025-08-28
卷期号:22: 894-878
摘要
To address the industry-wide and policy-driven requirements toward construction site safety monitoring, this paper develops a virtual assistant agent based on a large vision-language model (VLM), integrated into on-site surveillance camera system for real-time identification and alerting of unsafe worker behaviors. First, we designed a semi-automatic image-text labeling pipeline, employing in-context learning to enhance data annotation efficiency. Then, we established a two-stage curriculum learning paradigm to deeply embed construction domain knowledge into the VLM, which is eventually embedded into a real-time video analytical engine for safety compliance inspection and interactive visual question answering. The system has been deployed on a real construction site, with around 90% accuracy in identifying violations of work-at-height safety regulations.
科研通智能强力驱动
Strongly Powered by AbleSci AI