手势
发音
普通话
语音识别
模仿
心理学
特征(语言学)
计算机科学
人工智能
语言学
社会心理学
哲学
作者
Xiaotong Xi,Peng Li,Florence Baills,Pilar Prieto
出处
期刊:Journal of Speech Language and Hearing Research
[American Speech–Language–Hearing Association]
日期:2020-10-22
卷期号:63 (11): 3571-3585
被引量:18
标识
DOI:10.1044/2020_jslhr-20-00084
摘要
Purpose Research has shown that observing hand gestures mimicking pitch movements or rhythmic patterns can improve the learning of second language (L2) suprasegmental features. However, less is known about the effects of hand gestures on the learning of novel phonemic contrasts. This study examines (a) whether hand gestures mimicking phonetic features can boost L2 segment learning by naive learners and (b) whether a mismatch between the hand gesture form and the target phonetic feature influences the learning effect. Method Fifty Catalan native speakers undertook a short multimodal training session on two types of Mandarin Chinese consonants (plosives and affricates) in either of two conditions: Gesture and No Gesture. In the Gesture condition, a fist-to-open-hand gesture was used to mimic air burst, while the No Gesture condition included no such use of gestures. Crucially, while the hand gesture appropriately mimicked the air burst produced in plosives, this was not the case for affricates. Before and after training, participants were tested on two tasks, namely, the identification task and the imitation task. Participants' speech output was rated by five Chinese native speakers. Results The perception results showed that training with or without gestures yielded similar degrees of improvement for the identification of aspiration contrasts. By contrast, the production results showed that, while training without gestures did not help improve L2 pronunciation, training with gestures improved pronunciation, but only when the given gestures appropriately mimicked the phonetic properties they represented. Conclusions Results revealed that the efficacy of observing hand gestures on the learning of nonnative phonemes depends on the appropriateness of the form of those gestures relative to the target phonetic features. That is, hand gestures seem to be more useful when they appropriately mimic phonetic features. Supplemental Material https://doi.org/10.23641/asha.13105442
科研通智能强力驱动
Strongly Powered by AbleSci AI