Development of a Measure of Clinical Information Systems Expectations and Experiences

BACKGROUND/OBJECTIVES: The purpose of this study is to describe the development and initial psychometric properties of a measure of expectations and experiences regarding the impact of clinical information systems on work process and outcomes. RESEARCH DESIGN: Basic item analysis, confirmatory factor analysis, cross-validation factor analyses, and reliability analysis were used to assess the psychometric properties of the scale. SUBJECTS: The initial validation sample included registered nurses from a large Midwestern rural referral hospital that implemented electronic medical records and computerized provider order entry systems. Nurses from 3 other hospitals were used to cross-validate the factor structure of the scale. MEASURES: The scale assesses respondents' perceptions related to communication changes, changes in selected work behaviors, perceptions of the implementation strategy, and the impact on quality of patient care. The instrument can be used to assess perceptions before and after implementation. RESULTS: Confirmatory factor analysis generally supported the a priori factor structure for both expectations and experiences regarding the clinical information system. The consistency of the fit to the factor models was also high across the cross-validation samples. The scales demonstrated acceptable internal consistency in all the samples. CONCLUSIONS: Our findings suggest that the measure of clinical information systems expectations and experiences offers a valid and reliable tool for assessing the perceived impact of new clinical technology on work process and outcomes. This instrument can be useful before and after technology implementation by assisting in the identification of staff perceptions and concerns, thus allowing for targeted interventions to address these issues.