Highlight results, don't hide them: Enhance interpretation, reduce biases and improve reproducibility

作者
Paul A. Taylor,Richard C. Reynolds,Vince D. Calhoun,Javier González-Castillo,Daniel A. Handwerker,Peter A. Bandettini,Amanda F. Mejia,Gang Chen
出处
期刊:NeuroImage [Elsevier BV]
卷期号:274: 120138-120138 被引量:99
标识
DOI:10.1016/j.neuroimage.2023.120138
摘要

Most neuroimaging studies display results that represent only a tiny fraction of the collected data. While it is conventional to present "only the significant results" to the reader, here we suggest that this practice has several negative consequences for both reproducibility and understanding. This practice hides away most of the results of the dataset and leads to problems of selection bias and irreproducibility, both of which have been recognized as major issues in neuroimaging studies recently. Opaque, all-or-nothing thresholding, even if well-intentioned, places undue influence on arbitrary filter values, hinders clear communication of scientific results, wastes data, is antithetical to good scientific practice, and leads to conceptual inconsistencies. It is also inconsistent with the properties of the acquired data and the underlying biology being studied. Instead of presenting only a few statistically significant locations and hiding away the remaining results, studies should "highlight" the former while also showing as much as possible of the rest. This is distinct from but complementary to utilizing data sharing repositories: the initial presentation of results has an enormous impact on the interpretation of a study. We present practical examples and extensions of this approach for voxelwise, regionwise and cross-study analyses using publicly available data that was analyzed previously by 70 teams (NARPS; Botvinik-Nezer, et al., 2020), showing that it is possible to balance the goals of displaying a full set of results with providing the reader reasonably concise and "digestible" findings. In particular, the highlighting approach sheds useful light on the kind of variability present among the NARPS teams' results, which is primarily a varied strength of agreement rather than disagreement. Using a meta-analysis built on the informative "highlighting" approach shows this relative agreement, while one using the standard "hiding" approach does not. We describe how this simple but powerful change in practice-focusing on highlighting results, rather than hiding all but the strongest ones-can help address many large concerns within the field, or at least to provide more complete information about them. We include a list of practical suggestions for results reporting to improve reproducibility, cross-study comparisons and meta-analyses.

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
Curiousrss完成签到,获得积分10
刚刚
林好发布了新的文献求助30
刚刚
sss完成签到,获得积分10
刚刚
刚刚
香蕉觅云的应助被DU采纳,获得30
1秒前
1秒前
汉堡包的应助被伊瑟儿采纳,获得10
1秒前
Jasper的应助被ZRui采纳,获得10
1秒前
在水一方的应助被时倾采纳,获得10
2秒前
2秒前
大胆芯发布了新的文献求助30
2秒前
3秒前
3秒前
3秒前
3秒前
huhuiya完成签到 ,获得积分10
3秒前
希望天下0贩的0的应助被江sir采纳,获得10
3秒前
3秒前
你猜完成签到,获得积分10
3秒前
3秒前
hhh完成签到 ,获得积分20
4秒前
4秒前
4秒前
Q235完成签到,获得积分10
4秒前
六金发布了新的文献求助10
4秒前
星辰大海的应助被碎觉觉采纳,获得30
5秒前
科研通AI65的应助被Hasson采纳,获得10
5秒前
搬砖ing发布了新的文献求助10
5秒前
5秒前
领导范儿的应助被timi2026采纳,获得10
5秒前
DW的应助被卷毛羊在忙采纳,获得10
5秒前
黑皮鞋发布了新的文献求助10
6秒前
何曼慈发布了新的文献求助10
6秒前
168698发布了新的文献求助10
7秒前
7秒前
enzyme发布了新的文献求助10
7秒前
九儿完成签到 ,获得积分10
7秒前
zz完成签到,获得积分10
7秒前
LJL完成签到,获得积分10
7秒前
yuyu发布了新的文献求助10
7秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 1700
奈特基础组织学:配套组织病理学(第4版)(Netter's Essential Histology With Correlated Histopathology) 800
John McDowells Bildungstheorie 800
八旗制度の研究 600
plantTFDB 508
Resource Recovery Handbook 500
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8175943
求助须知:如何正确求助?哪些是违规求助? 9567501
关于积分的说明 21793186
捐赠科研通 7770490
什么是DOI,文献DOI怎么找? 3431935
关于科研通互助平台的介绍 2556294
邀请新用户注册赠送积分活动 2477485