Interpretable Machine Learning Model for Predicting and Assessing the Risk of Diabetic Nephropathy: Prediction Model Study

Introduction: Diabetic Nephropathy (DN), a severe complication of diabetes, is characterized by proteinuria, hypertension, and progressive renal function decline, potentially leading to end-stage renal disease. The International Diabetes Federation projects that by 2045, 783 million people will have diabetes, with 30%-40% of them developing DN. Current diagnostic approaches lack sufficient sensitivity and specificity for early detection and diagnosis, underscoring the need for an accurate, interpretable predictive model to enable timely intervention, reduce cardiovascular risks, and optimize healthcare costs. Methods: Our retrospective cohort study investigated 1,000 type-2 diabetes patients using data from electronic medical records collected between 2015 and 2020. The study design incorporated a sample of 444 patients with diabetic nephropathy and 556 without, focusing on demographics, clinical metrics such as blood pressure and glucose levels, and renal function markers. Data collection relied on electronic records, with missing values handled via multiple imputation and dataset balance achieved using SMOTE. In this study, advanced machine learning algorithms, namly XGBoost, CatBoost, and LightGBM, were utilized due to their robustness in handling complex datasets. Key metrics, including accuracy, precision, recall, F1 score, specificity, and area under the curve (AUC), were employed to provide a comprehensive assessment of model performance. Additionally, Explainable Machine Learning (XML) techniques, such as LIME and SHAP, were applied to enhance the transparency and interpretability of the models, offering valuable insights into their decision-making processes. Results: XGBoost and LightGBM demonstrated superior performance, with XGBoost achieving the highest accuracy of 86.87%, a precision of 88.90%, a recall of 84.40%, an f1 score of 86.44%, and a specificity of 89.12%. LIME and SHAP analyses provided insights into the contribution of individual features to elucidate the decision-making processes of these models, identifying serum creatinine, albumin, and lipoproteins as significant predictors. Conclusion: The developed machine learning model not only provides a robust predictive tool for early diagnosis and risk assessment of DN but also ensures transparency and interpretability, crucial for clinical integration. By enabling early intervention and personalized treatment strategies, this model has the potential to improve patient outcomes and optimize healthcare resource utilization.