建议(编程)
计算机科学
决策者
价值(数学)
管理科学
经验证据
知识管理
实证研究
信息系统
路径(计算)
决策支持系统
数据科学
风险分析(工程)
最优决策
简单(哲学)
光学(聚焦)
人工智能
信息处理
心理学
决策分析
决策问题
信息的价值
机器学习
运筹学
路径分析(统计学)
作者
Alessandra Cillo,Claudia Sessa,Canan Ulu,Emanuele Borgonovo
出处
期刊:Decision Analysis
[Institute for Operations Research and the Management Sciences]
日期:2026-06-24
标识
DOI:10.1287/deca.2025.0456
摘要
Human-in-the-loop (HiL) systems integrate human judgment with algorithmic output, combining computational processing with human oversight and expertise. Despite their growing prevalence as sources of advice in organizational decision making, the extent to which decision makers value HiL advice remains underexplored, particularly compared with the extensive literature on purely algorithmic advice. Using the Judge Advisor System paradigm, we compare advice from three sources—HiL systems, algorithms, and human experts—and systematically manipulate the provision of explicit accuracy information. Our findings are threefold. First, participants hold higher expectations of accuracy for HiL systems relative to algorithms and human experts, yet this does not lead to higher utilization of HiL advice. Second, explicit accuracy information increases advice utilization for all sources: more accurate sources are used more frequently, regardless of type. Third, within any given source, higher perceived accuracy correlates with greater advice utilization. These results suggest a clear path forward for organizations: HiL systems will be valued when they deliver on their promise of superior accuracy by leveraging complementary human and algorithmic capabilities. Organizations should focus on designing HiL systems that combine the unique strengths of each source, such as algorithmic data processing with human judgment in ambiguous environments, and on transparently communicating accuracy information. Successful adoption of HiL systems requires empirical evidence of accuracy gains in specific contexts, not assumptions about decision maker preferences for HiL systems. History: This paper has been accepted for the Decision Analysis Special Issue on Implications of Advances in Artificial Intelligence. Supplemental Material: The online appendix is available at https://doi.org/10.1287/deca.2025.0456 .
科研通智能强力驱动
Strongly Powered by AbleSci AI