Just Say No: Analyzing the Stance of Neural Dialogue Generation in Offensive Contexts

作者
Ashutosh Baheti,Maarten Sap,Alan Ritter,Mark Riedl
出处
期刊: [Association for Computational Linguistics]
卷期号:: 4846-4862 被引量:51
标识
DOI:10.18653/v1/2021.emnlp-main.397
摘要

Dialogue models trained on human conversations inadvertently learn to generate toxic responses. In addition to producing explicitly offensive utterances, these models can also implicitly insult a group or individual by aligning themselves with an offensive statement. To better understand the dynamics of contextually offensive language, we investigate the stance of dialogue model responses in offensive Reddit conversations. Specifically, we create TOXICHAT, a crowd-annotated dataset of 2,000 Reddit threads and model responses labeled with offensive language and stance. Our analysis reveals that 42% of human responses agree with toxic comments, whereas only 13% agree with safe comments. This undesirable behavior is learned by neural dialogue models, such as DialoGPT, which we show are two times more likely to agree with offensive comments. To enable automatic detection of offensive language, we fine-tuned transformerbased classifiers on TOXICHAT that achieve 0.71 F 1 for offensive labels and 0.53 Macro-F 1 for stance labels. Finally, we quantify the effectiveness of controllable text generation (CTG) methods to mitigate the tendency of neural dialogue models to agree with offensive comments. Compared to the baseline, our best CTG model achieves a 19% reduction in agreement with offensive comments and produces 29% fewer offensive replies. Our work highlights the need for further efforts to characterize and analyze inappropriate behavior in dialogue models, in order to help make them safer. 1

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
慕青的应助被noliey采纳,获得10
1秒前
1秒前
阿岳发布了新的文献求助10
1秒前
wanci的应助被wakada采纳,获得30
2秒前
eva发布了新的文献求助30
3秒前
成就盼易发布了新的文献求助10
4秒前
干昕慈发布了新的文献求助10
4秒前
4秒前
5秒前
舍我其谁发布了新的文献求助10
5秒前
秋风的应助被司徒南瓜饼采纳,获得10
5秒前
yunqi完成签到,获得积分10
5秒前
6秒前
6秒前
Luna完成签到,获得积分20
6秒前
不放弃完成签到,获得积分10
6秒前
7秒前
7秒前
初景的应助被甘甘甘甘甘采纳,获得20
7秒前
abab完成签到 ,获得积分10
7秒前
8秒前
慕新完成签到,获得积分10
9秒前
9秒前
PENG发布了新的文献求助10
10秒前
老实棒棒糖完成签到,获得积分10
11秒前
爆米花的应助被Gamera采纳,获得10
11秒前
laonaiyi发布了新的文献求助30
11秒前
11秒前
11秒前
隐形曼青的应助被斯文的莞采纳,获得10
11秒前
丘比特的应助被daisyyyyy采纳,获得10
11秒前
12秒前
12秒前
邹老头发布了新的文献求助150
13秒前
xiett完成签到 ,获得积分10
13秒前
脑洞疼的应助被133采纳,获得10
13秒前
传奇3的应助被梨梨梨采纳,获得10
14秒前
爆米花的应助被小树采纳,获得10
15秒前
FashionBoy的应助被WendyWen采纳,获得10
15秒前
15秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 1700
The World Atlas of Wine 9th edition 1000
奈特基础组织学:配套组织病理学(第4版)(Netter's Essential Histology With Correlated Histopathology) 800
John McDowells Bildungstheorie 800
八旗制度の研究 600
What Else Can I Tell You?: A Pragmatic Study of English Rhetorical Questions as Discursive and Argumentative Acts 500
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8165135
求助须知:如何正确求助?哪些是违规求助? 9558801
关于积分的说明 21747483
捐赠科研通 7755702
什么是DOI,文献DOI怎么找? 3428797
关于科研通互助平台的介绍 2553162
邀请新用户注册赠送积分活动 2473402