Exploring ChatGPT’s capabilities, stability, potential and risks in conducting psychological counseling through simulations in school counseling

心理学 心理咨询 心理咨询学 应用心理学 临床心理学
作者
Yang Ni,Yanzhuo Cao
出处
期刊: [Emerald Publishing Limited]
卷期号:2 (3): 213-239 被引量:12
标识
DOI:10.1108/mhdt-02-2025-0013
摘要

Purpose This study aims to examine ChatGPT-4’s potential and stability when simulating school-counseling dialogues, offering an exploratory snapshot of its ability to convey warmth, empathy and acceptance. Drawing on 80 real student questions, this paper aims to assess response consistency and identify risk markers, such as randomness and hallucination. The goal of this study is to inform future research, guide human–AI (artificial intelligence) collaboration and support policy development on deploying large language model chatbots for accessible mental health interventions. Design/methodology/approach This paper prompted ChatGPT-4 with 80 authentic college student counseling questions and collected three nondeterministic replies per query. Automated analysis used three natural language processing (NLP) models – EmoRoBERTa for emotion detection, a neural network for empathy classification and VADER for sentiment analysis – to quantify warmth, empathy and acceptance. Stability was evaluated via Fleiss’ κ for empathy labels and ICC(2,1) for continuous sentiment scores. Additional Chi-square and one-way ANOVA tests examined categorical shifts and mean-score drift, and Pearson correlation assessed the relation between question and response length. Findings ChatGPT-4 achieved 97.5% warm responses, 94.2% empathy classification and a mean compound sentiment score of 0.93 ± 0.19. Stability metrics indicated moderate reliability (κ = 0.59; ICC = 0.62), while occasional confusing or realization labels (2.5% of outputs) and minor sentiment drift underscored randomness as a risk. A positive correlation (r = 0.60, p < 0.001) revealed longer queries elicit longer replies. These results highlight both the promise and the limits of LLM chatbots in school-counseling simulations. Research limitations/implications As an offline simulation using a single GPT-4 model and automated proxies rather than clinician ratings or clinical outcomes, findings remain exploratory. The de-identified public data set may not capture live user dynamics. Future work should involve multi-model comparisons, mixed-methods validation with human raters and end-users, live pilot deployments and clinical trials to assess safety, usability and therapeutic impact in real-world educational settings. Practical implications High warmth and empathy rates suggest ChatGPT-4 could augment low-intensity support – drafting psycho-educational messages or after-hours coping tips under human oversight. Stability metrics can inform prompt-engineering benchmarks and guardrail triggers. Schools and self-help apps may pilot AI-assisted chat interfaces with escalation protocols, bias and privacy audits and human-in-the-loop triage to optimize counselor workflows, extend reach and mitigate risks through transparent policy and workflow design. Social implications Deployment of LLM chatbots can democratize mental health resources for youth, lowering barriers of cost, stigma and provider shortages. However, risks of misinformation, bias and overreliance necessitate digital-literacy education, equitable governance and community engagement frameworks. Policymakers and practitioners must balance innovation with safeguards – such as mandatory audit trails and accountability measures – to ensure vulnerable populations benefit safely from AI-mediated counseling. Originality/value This paper is among the first to apply quantitative stability metrics (κ, ICC) and NLP-based emotion analysis to ChatGPT-4 in a school-counseling simulation, enriched by a practitioner’s deployment insights. It integrates parasocial-interaction and computational social-science theories to link technical capabilities with design patterns, policy recommendations and a roadmap for future mixed-methods research on AI in mental-health interventions.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
刚刚
刚刚
1秒前
1秒前
AHMZI完成签到,获得积分10
1秒前
荣荣发布了新的文献求助10
1秒前
2秒前
Su发布了新的文献求助10
2秒前
打打的应助被zrf采纳,获得100
2秒前
molihuakai的应助被zdk采纳,获得10
2秒前
梦锡发布了新的文献求助10
2秒前
2秒前
zgmhemtt完成签到 ,获得积分10
2秒前
Song完成签到,获得积分10
3秒前
TTTTTT发布了新的文献求助10
3秒前
luyue9406的应助被nnn采纳,获得10
4秒前
今天发CNS了嘛完成签到,获得积分0
4秒前
仙人掌完成签到 ,获得积分10
5秒前
adu完成签到,获得积分10
5秒前
Mokwepa完成签到,获得积分20
5秒前
5秒前
小蘑菇的应助被贾文浩采纳,获得10
6秒前
Song发布了新的文献求助10
6秒前
6秒前
自由妙竹完成签到 ,获得积分10
6秒前
慕青的应助被科研通管家采纳,获得10
6秒前
华仔的应助被害怕的穆采纳,获得10
6秒前
Akim的应助被科研通管家采纳,获得10
6秒前
Maestro_S的应助被iQ采纳,获得10
6秒前
上官若男的应助被科研通管家采纳,获得10
6秒前
蓝天的应助被科研通管家采纳,获得10
7秒前
Owen的应助被xiaoyibabi采纳,获得30
7秒前
123564的应助被科研通管家采纳,获得10
7秒前
明理的帆布鞋完成签到,获得积分10
7秒前
SciGPT的应助被科研通管家采纳,获得10
7秒前
赘婿的应助被科研通管家采纳,获得10
7秒前
刘放发布了新的文献求助10
7秒前
小二郎的应助被科研通管家采纳,获得10
7秒前
123564的应助被科研通管家采纳,获得10
7秒前
7秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 1700
The World Atlas of Wine 9th edition 1000
奈特基础组织学:配套组织病理学(第4版)(Netter's Essential Histology With Correlated Histopathology) 800
John McDowells Bildungstheorie 800
八旗制度の研究 600
plantTFDB 508
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8168144
求助须知:如何正确求助?哪些是违规求助? 9561199
关于积分的说明 21759542
捐赠科研通 7759434
什么是DOI,文献DOI怎么找? 3429948
关于科研通互助平台的介绍 2553742
邀请新用户注册赠送积分活动 2474463