Is Relevancy Everything? A Deep-Learning Approach to Understand the Effect of Image-Text Congruence

同余(几何) 深度学习 图像(数学) 人工智能 心理学 计算机科学 认知心理学 数据科学 社会心理学
作者
Jingcun Cao,Xiaolin Li,Lingling Zhang
出处
期刊:Management Science [Institute for Operations Research and the Management Sciences]
卷期号:71 (12): 10579-10602 被引量:34
标识
DOI:10.1287/mnsc.2022.01896
摘要

Firms increasingly use a combination of image and text description when displaying products and engaging consumers. Existing research has examined consumers’ response to text and image stimuli separately but has yet to systematically consider how the semantic relationship between image and text impacts consumer choice. In this research, we conduct a series of multimethod empirical studies to examine the congruence between image- and text-based product representation. First, we propose a deep-learning approach to measure image-text congruence by building a state-of-the-art two-branch neural network model based on wide residual networks and bidirectional encoder representations from transformers. Next, we apply our method to data from an online reading platform and discover a U-shaped effect of image-text congruence: Consumers’ preference toward a product is higher when the congruence between the image and text representation is either high or low than when the congruence is at the medium level. We then conduct experiments to establish the causal effect of this finding and explore the underlying mechanisms. We further explore the generalizability of the proposed deep-learning model and our substantive finding in two additional settings. Our research contributes to the literature on consumer information processing and generates managerial implications for practitioners on how to strategically pair images and text on digital platforms. This paper was accepted by Duncan Simester, marketing. Funding: J. Cao acknowledges financial support from Young Scientists Fund of National Natural Science Foundation of China [Grant 72402192], the General Research Fund [Grant 17501423] and Early Career Scheme [Grant 27502521] of the Research Grants Council of Hong Kong, and the Institute of Behavioural and Decision Science, the University of Hong Kong (HKU). Supplemental Material: The online appendices and data files are available at https://doi.org/10.1287/mnsc.2022.01896 .
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
呆萌的晓槐完成签到,获得积分20
刚刚
JeaZ完成签到,获得积分10
刚刚
1秒前
爱猫的纭发布了新的文献求助10
2秒前
gooooood完成签到 ,获得积分10
3秒前
3秒前
huang发布了新的文献求助10
3秒前
4秒前
ding的应助被饺子采纳,获得10
5秒前
6秒前
HP完成签到 ,获得积分10
6秒前
咕噜咕噜完成签到,获得积分10
7秒前
ccc完成签到,获得积分10
7秒前
7秒前
thesky发布了新的文献求助10
7秒前
8秒前
独特思卉完成签到,获得积分10
8秒前
研友_nxejJZ完成签到,获得积分10
8秒前
爱猫的纭完成签到,获得积分10
8秒前
9秒前
10秒前
小二郎的应助被why采纳,获得10
10秒前
GGYK完成签到,获得积分10
10秒前
MiaCong发布了新的文献求助10
11秒前
11秒前
wangxin发布了新的文献求助10
11秒前
11秒前
11秒前
11秒前
拼搏路人完成签到,获得积分10
12秒前
12秒前
12秒前
表弟慢热手的应助被威武苑睐采纳,获得50
12秒前
第一作者发布了新的文献求助10
13秒前
13秒前
Gorone发布了新的文献求助10
13秒前
gwgplmz发布了新的文献求助10
14秒前
thesky完成签到,获得积分10
15秒前
15秒前
所所的应助被Bbibo采纳,获得30
15秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 1700
The World Atlas of Wine 9th edition 1000
奈特基础组织学:配套组织病理学(第4版)(Netter's Essential Histology With Correlated Histopathology) 800
八旗制度の研究 600
高分子基功能界面水蒸发材料与应用研究 500
外场增强的水汽发电研究 500
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8187652
求助须知:如何正确求助?哪些是违规求助? 9575758
关于积分的说明 21842805
捐赠科研通 7785538
什么是DOI,文献DOI怎么找? 3435073
关于科研通互助平台的介绍 2559480
邀请新用户注册赠送积分活动 2481963