计算机科学
人工智能
自然语言处理
水准点(测量)
风险评估
机器学习
一般化
麦克内马尔试验
相关性(法律)
补语(音乐)
代表(政治)
动作(物理)
视觉推理
组分(热力学)
异常检测
资源(消歧)
范畴变量
骨料(复合)
风险管理
注释
关系(数据库)
概化理论
语言模型
自然语言
语义学(计算机科学)
任务分析
计算语言学
模型风险
判别式
作者
Chien-Hao Tseng,Min-Yu Chen,Meng-Wei Lin,Jyh-Horng Wu,Chung-I Huang
标识
DOI:10.32604/cmc.2026.083337
摘要
Context-aware driving assistance must do more than detect objects: it has to identify the cues that materially affect risk, separate observable evidence from inference, and produce recommendations that humans can audit. This paper presents a grounded multi-agent multimodal large language model (MLLM) framework for interpretable risk assessment in driving scenes. The framework decomposes reasoning into four stages—context relevance evaluation, visual interpretation, factual verification with anomaly extraction, and risk assessment with action recommendation—so that the final advisory is generated only from a verified intermediate representation rather than directly from a free-form scene description. We evaluate the framework on a manually labeled benchmark derived from BDD100K covering traffic-sign interpretation, traffic-density assessment, and pedestrian–vehicle interaction risk. The benchmark contains 600 frames with three-rater annotation and majority-vote labels (Fleiss’ κ=0.79 on risk levels); we explicitly discuss the implications of this scale for generalization and complement it with a multi-backbone stress test. Across five independent runs, the proposed framework improves risk accuracy from 74.3±0.9% to 84.8±0.6% and macro-F1 from 72.8±1.1% to 83.1±0.7% over a single-agent MLLM baseline. The hallucination rate—defined as the fraction of outputs containing at least one entity, attribute, or relation that has no visual support in the source frame—drops from 18.7% to 8.9%, and the actionability score—a five-point human rating averaged over usefulness, specificity, and visual consistency—rises from 3.62 to 4.28. McNemar tests confirm that the gain in risk accuracy is statistically significant (p<0.001). The framework is intended as a semantic decision-support layer for explainable advanced driver-assistance systems and human-centered autonomous-driving interfaces.
科研通智能强力驱动
Strongly Powered by AbleSci AI