管道(软件)
人工智能
F1得分
计算机科学
深度学习
关系抽取
分类器(UML)
任务(项目管理)
注释
机器学习
自然语言处理
命名实体识别
信息抽取
工程类
系统工程
程序设计语言
作者
Yefeng Wang,Yunpeng Zhao,Dalton Schutte,Jiang Bian,Rui Zhang
出处
期刊:JAMIA open
[University of Oxford]
日期:2021-10-01
卷期号:4 (4): ooab081-ooab081
被引量:21
标识
DOI:10.1093/jamiaopen/ooab081
摘要
OBJECTIVE: The objective of this study is to develop a deep learning pipeline to detect signals on dietary supplement-related adverse events (DS AEs) from Twitter. MATERIALS AND METHODS: We obtained 247 807 tweets ranging from 2012 to 2018 that mentioned both DS and AE. We designed a tailor-made annotation guideline for DS AEs and annotated biomedical entities and relations on 2000 tweets. For the concept extraction task, we fine-tuned and compared the performance of BioClinical-BERT, PubMedBERT, ELECTRA, RoBERTa, and DeBERTa models with a CRF classifier. For the relation extraction task, we fine-tuned and compared BERT models to BioClinical-BERT, PubMedBERT, RoBERTa, and DeBERTa models. We chose the best-performing models in each task to assemble an end-to-end deep learning pipeline to detect DS AE signals and compared the results to the known DS AEs from a DS knowledge base (ie, iDISK). RESULTS: DeBERTa-CRF model outperformed other models in the concept extraction task, scoring a lenient microaveraged F1 score of 0.866. RoBERTa model outperformed other models in the relation extraction task, scoring a lenient microaveraged F1 score of 0.788. The end-to-end pipeline built on these 2 models was able to extract DS indication and DS AEs with a lenient microaveraged F1 score of 0.666. CONCLUSION: We have developed a deep learning pipeline that can detect DS AE signals from Twitter. We have found DS AEs that were not recorded in an existing knowledge base (iDISK) and our proposed pipeline can as sist DS AE pharmacovigilance.
科研通智能强力驱动
Strongly Powered by AbleSci AI