词(群论)
计算机科学
自然语言处理
人工智能
相似性(几何)
类比
代表(政治)
意义(存在)
语义学(计算机科学)
按频率列出的单词列表
钥匙(锁)
语义相似性
空格(标点符号)
语言学
心理学
判决
哲学
心理治疗师
法学
程序设计语言
图像(数学)
操作系统
政治
计算机安全
政治学
作者
Yilin Niu,Ruobing Xie,Zhiyuan Liu,Maosong Sun
摘要
Sememes are minimum semantic units of word meanings, and the meaning of each word sense is typically composed by several sememes. Since sememes are not explicit for each word, people manually annotate word sememes and form linguistic common-sense knowledge bases. In this paper, we present that, word sememe information can improve word representation learning (WRL), which maps words into a low-dimensional semantic space and serves as a fundamental step for many NLP tasks. The key idea is to utilize word sememes to capture exact meanings of a word within specific contexts accurately. More specifically, we follow the framework of Skip-gram and present three sememe-encoded models to learn representations of sememes, senses and words, where we apply the attention scheme to detect word senses in various contexts. We conduct experiments on two tasks including word similarity and word analogy, and our models significantly outperform baselines. The results indicate that WRL can benefit from sememes via the attention scheme, and also confirm our models being capable of correctly modeling sememe information.
科研通智能强力驱动
Strongly Powered by AbleSci AI