Predicting the diagnosis of HIV and sexually transmitted infections among men who have sex with men using machine learning approaches

Abstract

Objectives

We aimed to develop machine learning models and evaluate their performance in predicting HIV and sexually transmitted infections (STIs) diagnosis based on a cohort of Australian men who have sex with men (MSM).

Methods

We collected clinical records of 21,273 Australian MSM during 2011–2017. We compared accuracies for predicting HIV and STIs (syphilis, gonorrhoea, chlamydia) diagnosis using four machine learning approaches against a multivariable logistic regression (MLR) model.

Results

Machine learning approaches consistently outperformed MLR. Gradient boosting machine (GBM) achieved the highest area under the receiver operator characteristic curve for HIV (76.3%) and STIs (syphilis, 85.8%; gonorrhoea, 75.5%; chlamydia, 68.0%), followed by extreme gradient boosting (71.1%, 82.2%, 70.3%, 66.4%), random forest (72.0%, 81.9%, 67.2%, 64.3%), deep learning (75.8%, 81.0%, 67.5%, 65.4%) and MLR (69.8%, 80.1%, 67.2%, 63.2%). GBM models demonstrated the ten greatest predictors collectively explained 62.7-73.6% of variations in predicting HIV/STIs. STIs symptoms, past syphilis infection, age, time living in Australia, frequency of condom use with casual male sexual partners during receptive anal sex and the number of casual male sexual partners in the past 12 months were most commonly identified predictors.

Conclusions

Machine learning approaches are advantageous over multivariable logistic regression models in predicting HIV/STIs diagnosis.