A Study on Intelligent Evaluation Methods for English Writing Proficiency Based on Semantic Feature Extraction

作者
Pingping Liu
出处
期刊: 卷期号:42 (4): 1-20
标识
DOI:10.65102/is2026758
摘要

Addressing the issues of insufficient scoring granularity, weak cross-task stability, and unclear feedback evidence in university English writing instruction and intelligent grading scenarios, this paper proposes an intelligent evaluation method for English writing proficiency based on semantic feature extraction.First, a multi-source writing evaluation sample space is constructed around ASAP++, ICLE++, DREsS, and PERSUADE 1.0, and a unified mapping of composite scores, fine-grained traits, and rubric rules is established;Next, we establish a prompt-aware semantic feature extraction and multi-view joint scoring model, incorporating global semantic meaning of the prompt and essay, sentence-level coverage and local coherence, paragraph organizational relationships, and language support features into the scoring framework. By means of consistency constraint conditions, we have realized the combined forecast of the total score and five-dimensional meta-characteristics; In the end, experiments have been done by us under three evaluation schemes: inside-prompt, one-prompt-leave-out, and based-on-rubric. The results obtained by us indicate that our method attains a QWK of 0.862 and an MAE of 0.348 on the dataset ASAP++, attains a QWK of 0.821 for composite score and a trait-average QWK of 0.793 on the dataset ICLE++, and attains a Macro-F1 of 0.734 and a QWK of 0.796 on the dataset DREsS, hence all of these performances are better than the baseline methods. Experiments on low-resource conditions further prove that even when there is only twenty percent of training data used, the model still keeps a QWK of 0.713, hence this shows the model has good efficiency in utilizing samples. Case studies and error analysis indicate that this method can with reliability distinguish typical problems like inadequate topic answering, disconnected text development, and feeble language support, and hence has the possibility for being put into human-check working flows.

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
于阳完成签到,获得积分20
刚刚
刚刚
霜降完成签到,获得积分10
1秒前
2秒前
成事在人307完成签到,获得积分10
3秒前
DR-JHan发布了新的文献求助10
3秒前
SciGPT的应助被初景采纳,获得20
3秒前
syjjj发布了新的文献求助10
5秒前
小马甲的应助被云天河采纳,获得10
5秒前
烟花的应助被于阳采纳,获得10
5秒前
你好完成签到 ,获得积分10
6秒前
7秒前
情怀的应助被橙子不喝橙汁采纳,获得10
7秒前
科研通AI6.4的应助被三元采纳,获得10
7秒前
7秒前
缠流子发布了新的文献求助10
8秒前
可爱的函函的应助被dbwdqqr采纳,获得10
8秒前
9秒前
syjjj完成签到,获得积分10
9秒前
10秒前
旺仔完成签到 ,获得积分10
10秒前
zys发布了新的文献求助10
10秒前
小守城完成签到,获得积分10
11秒前
11秒前
烟花的应助被zz采纳,获得10
11秒前
科研通AI6.4的应助被li采纳,获得10
11秒前
酷波er的应助被mastwu采纳,获得10
11秒前
hh完成签到,获得积分10
11秒前
六橙橙完成签到,获得积分10
12秒前
12秒前
yoqalux完成签到 ,获得积分10
12秒前
不想接受发布了新的文献求助10
13秒前
大个的应助被陈咬金采纳,获得10
13秒前
香蕉觅云的应助被严金鱼采纳,获得10
13秒前
14秒前
lxt完成签到,获得积分10
14秒前
kevin发布了新的文献求助10
14秒前
14秒前
搜集达人的应助被dys采纳,获得10
15秒前
15秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
Das Matthäusevangelium: Kapitel 1:1–17 1000
IRTSD: Open-Source Data and Toolset for Electromagnetic Transient Analysis of Disturbances and IBR Control Malfunctions in Transmission Systems 1000
Comprehensive Medicinal Chemistry IV (4th Edition) 800
Entre Praga y Madrid : los contactos checoslovaco-españoles (1948-1977) 600
A REVIEW OF THE V-22 DYNAMICS VALIDATION PROGRAM 600
Les Mots du discours 600
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8120786
求助须知:如何正确求助?哪些是违规求助? 9525475
关于积分的说明 21556464
捐赠科研通 7699359
什么是DOI,文献DOI怎么找? 3415193
关于科研通互助平台的介绍 2541004
邀请新用户注册赠送积分活动 2455434