The Chinese Version of the DigiHealthCom (Digital Health Competence) Instrument for Assessing Digital Health Competence of Health Care Professionals: Translation, Adaptation, and Validation Study

Abstract Background Digital health competence is increasingly recognized as a core competence for health care professionals. A comprehensive evaluation of knowledge, skills, performance, values, and attitudes necessary to adapt to evolving digital health technologies is essential. DigiHealthCom (Digital Health Competence) is a well-established instrument designed to assess digital health competence across diverse health care professionals. Objective This study aimed to translate and culturally adapt DigiHealthCom into simplified Chinese (Mandarin) and verify its reliability and validity in assessing digital health competence of Chinese health care professionals. Methods DigiHealthCom was translated into Chinese following the guideline proposed by its original developers. The cultural adaptation involved expert review and cognitive interviewing. Internal consistency, test-retest reliability, content validity, convergent validity, discriminant validity, and factor structure were examined. Item analysis tested item discrimination, item correlation, and item homogeneity. Internal consistency was assessed using Cronbach α, and test-retest reliability was measured using the intraclass correlation coefficient. Content validity was assessed through both item and scale content validity indices. Convergent validity was measured by the Average Variance Extracted and Composite Reliability, while discriminant validity was measured by the heterotrait-monotrait ratio. A five-dimension model of DigiHealthCom was confirmed using confirmatory factor analysis. Results The finalized Chinese version of the DigiHealthCom was completed after addressing differences between the back-translations and the original version. No discrepancies affecting item clarity were reported during cognitive interviewing. The validation process involved 398 eligible health care professionals from 36 cities across 15 provinces in China, with 43 participants undergoing a retest after a 2-week interval. Critical ratio values (range 16.05‐23.77, P <.001), item-total correlation coefficients (range 0.69‐0.89), and Cronbach α if the item deleted (range 0.91‐0.96) indicated satisfactory item discrimination, item correlation, and item homogeneity. Cronbach α for dimensions and the scale ranged from 0.94 to 0.98, indicating good internal consistency. The intraclass correlation coefficient was 0.90 (95% CI 0.81‐0.95), indicating good test-retest reliability. Item content validity index ranged from 0.82 to 1.00, and the scale content validity index was 0.97, indicating satisfactory content validity. Convergent validity (average variance extracted: 0.60‐0.79; composite reliability: 0.94‐0.95) and divergent validity (heterotrait-monotrait ratio: 0.72‐0.89) were satisfactory. Confirmatory factor analysis confirmed a well-fit five-dimension model (robust chi-square to df ratio=3.10, comparative fit index=0.91, Tucker-Lewis index=0.90, incremental fit index=0.91, root-mean-square error of approximation=0.07, standardized root-mean-square residual=0.05), with each item having a factor loading exceeding 0.40. Conclusions The Chinese version of DigiHealthCom has been proved to be reliable and valid. It is now available for assessing digital health competence among Chinese health care professionals. This assessment can be used to guide health care policy makers and educators in designing comprehensive and implementable educational programs and interventions.