稳健性(进化)
计算机科学
发声
人工智能
语音识别
机器学习
深度学习
光学(聚焦)
质量评定
均方误差
相关性
基线(sea)
语音处理
感知
质量(理念)
人工神经网络
皮尔逊积矩相关系数
离群值
声道
相关系数
自然语言处理
变化(天文学)
基础(证据)
作者
Whenty Ariyanti,Kuan‐Yu Chen,Sabato Marco Siniscalchi,Hsin‐Min Wang,Yu Tsao
标识
DOI:10.1109/jbhi.2025.3644692
摘要
Perceptual voice quality assessment plays a vital role in diagnosing and monitoring voice disorders. Traditional methods, such as the Consensus Auditory-Perceptual Evaluation of Voice (CAPE-V) and the Grade, Roughness, Breathiness, Asthenia, and Strain (GRBAS) scales, rely on expert raters and are prone to inter-rater variability, emphasizing the need for objective solutions. This study introduces the Voice Quality Assessment Network (VOQANet), a deep learning framework that employs an attention mechanism and Speech Foundation Model (SFM) embeddings to extract high-level features. To further enhance performance, we propose VOQANet+, which integrates self-supervised SFM embeddings with low-level acoustic descriptors-namely jitter, shimmer, and harmonics-to-noise ratio (HNR). Unlike previous approaches that focus solely on vowel-based phonation (PVQD-A), our models are evaluated on both vowel-level and sentence-level speech (PVQD-S) to assess generalizability. Experimental results demonstrate that sentence-based inputs yield higher accuracy, particularly at the patient level. Overall, VOQANet consistently outperforms baseline models in terms of root mean squared error (RMSE) and Pearson correlation coefficient across CAPE-V and GRBAS dimensions, with VOQANet+ achieving even greater performance gains. Additionally, VOQANet+ maintains consistent performance under noisy conditions, suggesting enhanced robustness for real-world and telehealth applications. This work highlights the value of combining SFM embeddings with low-level features for accurate and robust pathological voice assessment.
科研通智能强力驱动
Strongly Powered by AbleSci AI