按频率列出的单词列表
词(群论)
相关性
计算机科学
语言学
自然语言处理
人工智能
心理学
数学
判决
几何学
哲学
作者
Kumiko Tanaka‐Ishii,Hiroshi Terada
标识
DOI:10.1111/j.1467-9582.2010.01176.x
摘要
Abstract. Word frequency is assumed to correlate with word familiarity, but the strength of this correlation has not been thoroughly investigated. In this paper, we report on our analysis of the correlation between a word familiarity rating list obtained through a psycholinguistic experiment and the log‐frequency obtained from various corpora of different kinds and sizes (up to the terabyte scale) for English and Japanese. Major findings are threefold: First, for a given corpus, familiarity is necessary for a word to achieve high frequency, but familiar words are not necessarily frequent. Second, correlation increases with the corpus data size. Third, a corpus of spoken language correlates better than one of written language. These findings suggest that cognitive familiarity ratings are correlated to frequency, but more highly to that of spoken rather than written language.
科研通智能强力驱动
Strongly Powered by AbleSci AI