Validating Generative AI for Health Communication Research: Identifying and Prioritizing Parental HPVP Vaccine Hesitancy Beliefs

作者
Emily K McKinley
出处
期刊:California Digital Library - eScholarship [California Digital Library]
摘要

Health communication researchers are increasingly utilizing generative artificial intelligence (AI) and large language models (LLMs) in the research process, often before shared standards exist for validating outputs. Validation is especially important in formative research because the beliefs selected as message targets shape what a campaign can address. This dissertation develops and validates a reproducible, human-in-the-loop method for identifying which beliefs an audience holds and which are most strongly associated with vaccination intention. It also tests where model output can support that work and where human data remain necessary. Parental hesitancy toward adolescent human papillomavirus vaccination among rural U.S. parents serves as the test case. Study 1 uses GPT models to extract parental hesitancy beliefs from 519 published studies across 61 countries and synthesize them into a taxonomy, with human validation at each stage. Extraction was highly accurate for factual study characteristics and moderately accurate for belief statements. Human coders applied the finished 104-category taxonomy with high reliability. A small set of beliefs accounted for most documented concern worldwide, and thirteen categories appeared in all six WHO regions. Study 2 administers a 39-item instrument derived from the taxonomy to 372 rural parents and ranks beliefs by prevalence and association with vaccination intention using Hornik and Woolf’s percentage-to-gain approach. Concerns about vaccine safety, institutional trust, and perceived necessity ranked highest as candidate message targets, while practical barriers ranked lowest. Provider recommendation was associated with higher intention but did not resolve the leading concerns. Priorities also differed across subgroups defined by political ideology, child age, and race or ethnicity. Study 3 tests whether that prioritization step can be simulated. Four large language models answer the same instrument as simulated versions of the surveyed parents. Simulated parents recovered the human ranking above chance in 23 of 24 configurations, but no configuration reached the agreement expected from a second real sample. Error originated primarily in the simulated beliefs, which showed miscalibrated prevalence, compressed variance, and amplified belief-intention associations. The simulations also flattened subgroup differences that would matter for tailored messaging. Together, the studies show that large language models can accelerate belief identification when embedded in a human-validated pipeline.

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
crazyant完成签到,获得积分20
刚刚
刚刚
王紫晴完成签到,获得积分20
刚刚
why发布了新的文献求助30
刚刚
刚刚
1秒前
wwwww完成签到,获得积分20
1秒前
1秒前
酷波er的应助被zyy采纳,获得30
1秒前
研友_VZG7GZ的应助被NJ采纳,获得10
2秒前
传奇3的应助被坚强白昼采纳,获得10
2秒前
田様的应助被LEON采纳,获得10
3秒前
3秒前
4秒前
4秒前
4秒前
4秒前
缥缈月光发布了新的文献求助10
5秒前
小羽完成签到,获得积分10
5秒前
WW完成签到,获得积分10
6秒前
6秒前
大气的fgyyhjj完成签到,获得积分10
7秒前
7秒前
Hello的应助被怕孤单的德天采纳,获得10
7秒前
谦让钥匙完成签到,获得积分10
7秒前
ami发布了新的文献求助10
7秒前
翟思宇发布了新的文献求助10
7秒前
8秒前
8秒前
何浏亮发布了新的文献求助10
8秒前
9秒前
DW的应助被小马采纳,获得10
11秒前
闲云野鹤完成签到,获得积分10
11秒前
彬彬完成签到,获得积分10
12秒前
谦让钥匙发布了新的文献求助10
12秒前
吗喽发布了新的文献求助10
12秒前
沉睡千年的蛆完成签到,获得积分10
13秒前
典雅秋白完成签到,获得积分10
13秒前
zyy发布了新的文献求助30
13秒前
温骐华完成签到 ,获得积分10
14秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 1700
The World Atlas of Wine 9th edition 1000
奈特基础组织学:配套组织病理学(第4版)(Netter's Essential Histology With Correlated Histopathology) 800
八旗制度の研究 600
Boundaries and Bodhisattvas 500
高分子基功能界面水蒸发材料与应用研究 500
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8181940
求助须知:如何正确求助?哪些是违规求助? 9571697
关于积分的说明 21819181
捐赠科研通 7778330
什么是DOI,文献DOI怎么找? 3433556
关于科研通互助平台的介绍 2557767
邀请新用户注册赠送积分活动 2479621