亲爱的研友该休息了!由于当前在线用户较少,发布求助请尽量完整地填写文献信息,科研通机器人24小时在线,伴您度过漫漫科研夜!身体可是革命的本钱,早点休息,好梦!

Data-driven evolution of water quality models: An in-depth investigation of innovative outlier detection approaches-A case study of Irish Water Quality Index (IEWQI) model

离群值 异常检测 数据挖掘 计算机科学 索引(排版) 公制(单位) 统计模型 水质 可靠性(半导体) 数据建模 机器学习 人工智能 工程类 数据库 生物 功率(物理) 运营管理 生态学 量子力学 万维网 物理
作者
Md Galal Uddin,Azizur Rahman,Firouzeh Rosa Taghikhah,Agnieszka I. Olbert
出处
期刊:Water Research [Elsevier BV]
卷期号:255: 121499-121499 被引量:116
标识
DOI:10.1016/j.watres.2024.121499
摘要

Recently, there has been a significant advancement in the water quality index (WQI) models utilizing data-driven approaches, especially those integrating machine learning and artificial intelligence (ML/AI) technology. Although, several recent studies have revealed that the data-driven model has produced inconsistent results due to the data outliers, which significantly impact model reliability and accuracy. The present study was carried out to assess the impact of data outliers on a recently developed Irish Water Quality Index (IEWQI) model, which relies on data-driven techniques. To the author's best knowledge, there has been no systematic framework for evaluating the influence of data outliers on such models. For the purposes of assessing the outlier impact of the data outliers on the water quality (WQ) model, this was the first initiative in research to introduce a comprehensive approach that combines machine learning with advanced statistical techniques. The proposed framework was implemented in Cork Harbour, Ireland, to evaluate the IEWQI model's sensitivity to outliers in input indicators to assess the water quality. In order to detect the data outlier, the study utilized two widely used ML techniques, including Isolation Forest (IF) and Kernel Density Estimation (KDE) within the dataset, for predicting WQ with and without these outliers. For validating the ML results, the study used five commonly used statistical measures. The performance metric (R2) indicates that the model performance improved slightly (R2 increased from 0.92 to 0.95) in predicting WQ after removing the data outlier from the input. But the IEWQI scores revealed that there were no statistically significant differences among the actual values, predictions with outliers, and predictions without outliers, with a 95% confidence interval at p < 0.05. The results of model uncertainty also revealed that the model contributed <1% uncertainty to the final assessment results for using both datasets (with and without outliers). In addition, all statistical measures indicated that the ML techniques provided reliable results that can be utilized for detecting outliers and their impacts on the IEWQI model. The findings of the research reveal that although the data outliers had no significant impact on the IEWQI model architecture, they had moderate impacts on the rating schemes' of the model. This finding indicated that detecting the data outliers could improve the accuracy of the IEWQI model in rating WQ as well as be helpful in mitigating the model eclipsing problem. In addition, the results of the research provide evidence of how the data outliers influenced the data-driven model in predicting WQ and reliability, particularly since the study confirmed that the IEWQI model's could be effective for accurately rating WQ despite the presence of the data outliers in the input. It could occur due to the spatio-temporal variability inherent in WQ indicators. However, the research assesses the influence of data input outliers on the IEWQI model and underscores important areas for future investigation. These areas include expanding temporal analysis using multi-year data, examining spatial outlier patterns, and evaluating detection methods. Moreover, it is essential to explore the real-world impacts of revised rating categories, involve stakeholders in outlier management, and fine-tune model parameters. Analysing model performance across varying temporal and spatial resolutions and incorporating additional environmental data can significantly enhance the accuracy of WQ assessment. Consequently, this study offers valuable insights to strengthen the IEWQI model's robustness and provides avenues for enhancing its utility in broader WQ assessment applications. Moreover, the study successfully adopted the framework for evaluating how data input outliers affect the data-driven model, such as the IEWQI model. The current study has been carried out in Cork Harbour for only a single year of WQ data. The framework should be tested across various domains for evaluating the response of the IEWQI model's in terms of the spatio-temporal resolution of the domain. Nevertheless, the study recommended that future research should be conducted to adjust or revise the IEWQI model's rating schemes and investigate the practical effects of data outliers on updated rating categories. However, the study provides potential recommendations for enhancing the IEWQI model's adaptability and reveals its effectiveness in expanding its applicability in more general WQ assessment scenarios.

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
Treayoung完成签到 ,获得积分10
1秒前
2秒前
竹林风完成签到 ,获得积分10
4秒前
13秒前
彭于晏的应助被椰子云采纳,获得10
13秒前
14秒前
14秒前
小蘑菇的应助被海藻采纳,获得10
15秒前
找找完成签到 ,获得积分10
18秒前
南宫雪发布了新的文献求助30
18秒前
22秒前
22秒前
22秒前
ding的应助被coco采纳,获得10
22秒前
Maestro_S的应助被纯情的阁采纳,获得10
25秒前
海藻发布了新的文献求助10
26秒前
omoily发布了新的文献求助10
26秒前
Coral369发布了新的文献求助10
28秒前
自信紫夏完成签到,获得积分10
29秒前
ze完成签到,获得积分10
35秒前
VT发布了新的文献求助10
40秒前
41秒前
43秒前
情怀的应助被肉包子采纳,获得10
46秒前
46秒前
852的应助被Hidos采纳,获得30
47秒前
47秒前
王老裂发布了新的文献求助10
48秒前
48秒前
49秒前
h11的应助被纯情的阁采纳,获得10
49秒前
ze发布了新的文献求助10
50秒前
50秒前
王老裂发布了新的文献求助10
51秒前
王老裂发布了新的文献求助10
51秒前
余铸海完成签到,获得积分10
52秒前
王老裂发布了新的文献求助10
52秒前
52秒前
清爽笙完成签到,获得积分10
53秒前
h11的应助被ming采纳,获得10
55秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 1500
The World Atlas of Wine 9th edition 1000
奈特基础组织学:配套组织病理学(第4版)(Netter's Essential Histology With Correlated Histopathology) 800
John McDowells Bildungstheorie 800
八旗制度の研究 600
What Else Can I Tell You?: A Pragmatic Study of English Rhetorical Questions as Discursive and Argumentative Acts 500
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8158601
求助须知:如何正确求助?哪些是违规求助? 9554379
关于积分的说明 21719104
捐赠科研通 7748129
什么是DOI,文献DOI怎么找? 3427052
关于科研通互助平台的介绍 2551912
邀请新用户注册赠送积分活动 2471285