Incorporating end-user perspectives into the development of a machine learning algorithm for first time perinatal depression prediction

Abstract Objective Machine learning algorithms can advance clinical care, including identifying mental health conditions. These algorithms are often developed without considering the perspectives of the affected populations. This study describes the process of incorporating end-user perspectives into the development and implementation planning of a prediction algorithm for new perinatal depression onset. Materials and Methods A focus group (N = 12 providers) and four virtual community engagement studios (N = 21 patients) were conducted. The project team presented on the initial development of a novel prediction algorithm used to detect first time perinatal depression. Rapid qualitative analysis coded the prediction algorithm’s completeness, interpretability, and acceptability to stakeholders, with the goal of informing clinical implementation of a patient-facing screener produced from the prediction algorithm. Results Providers and patients showed consensus on the interpretability of the prediction algorithm’s variables and discussed additional variables believed to be predictive of depression to ensure its completeness. In terms of acceptability, patients expressed a desire to discuss predictive risk screening results with their provider, while providers voiced concerns about limited bandwidth for these discussions. Both groups identified the need for post-screening resource connection but raised concerns over the availability of depression prevention specific resources. Providers and patients reported positively about their engagement in the sessions. Discussion Qualitative findings were incorporated into iterative algorithm development and informed an implementation pilot plan. Conclusion This study demonstrates how the expertise of the end-users of a risk prediction algorithm can be incorporated into its development, which may ultimately increase clinical adoption.