操作化
心理学
语用学
会话分析
对话
推论
论证(复杂分析)
认知心理学
能力(人力资源)
背景(考古学)
社会心理学
语言学
人工智能
计算机科学
认识论
沟通
化学
古生物学
哲学
生物
生物化学
出处
期刊:Language Testing
[SAGE Publishing]
日期:2014-11-27
卷期号:32 (2): 199-225
被引量:181
标识
DOI:10.1177/0265532214557113
摘要
This study investigates the validity of assessing L2 pragmatics in interaction using mixed methods, focusing on the evaluation inference. Open role-plays that are meaningful and relevant to the stakeholders in an English for Academic Purposes context were developed for classroom assessment. For meaningful score interpretations and accurate evaluations of interaction-involved pragmatic performances, interaction-sensitive data-driven rating criteria were developed, based on the qualitative analyses of examinees’ role-play performances. The conversation analysis performed on the data revealed various pragmatic and interactional features indicative of differing levels of pragmatic competence in interaction. The FACETS analysis indicated that the role-plays stably differentiated between the varying degrees of the 102 examinees’ pragmatic abilities. The raters showed internal consistency despite their differing degrees of severity. Stable fit statistics and distinct difficulties were reported within each of the interaction-sensitive rating criteria.The findings served as backing for the evaluation inference in the validity argument. Finally, implications of the findings in operationalizing interaction-involved language performances and developing rating criteria are discussed.
科研通智能强力驱动
Strongly Powered by AbleSci AI