Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?


Citing this Article

Right click to copy or hit: ctrl+c (cmd+c on mac)

Published on 30.12.16 in Vol 2, No 1 (2016): December

This paper is in the following e-collection/theme issue:


    Developing and Implementing an Electronic Patient-Reported Outcomes Measurement Using REDCap in Usual Care Psychiatric Settings

    1McLean Hospital, Belmont, MA, United States

    2Department of Health Care Policy, Harvard Medical School, Boston, MA, United States

    *all authors contributed equally

    Corresponding Author:

    Alisa Busch, MD, MS

    McLean Hospital

    Mailstop 226

    115 Mill St

    Belmont, MA, 02467

    United States

    Phone: 1 617 855 2989

    Fax:1 617 855 2714



    Background: Finding ways to feasibly and cost-efficiently measure patient-reported outcomes in psychiatric routine care settings is critical to facilitate patient engagement in care, improve patient outcomes, and assess the performance of our treatment programs. McLean Hospital is a free-standing psychiatric hospital that is part of the Partners HealthCare network and offers a full continuum of psychiatric care (inpatient, residential, partial hospital, and outpatient services) located on multiple campuses. We began an electronic patient-reported outcomes measurement program, the Clinical Measurement Initiative (CMI), in November 2010.

    Objective: To describe qualitatively and quantitatively the build and implementation experience of the McLean CMI program.

    Methods: The CMI aims to inform individual patient care, assist with quality assessment of clinical programs, and facilitate clinical research. On admission, discharge, and interim points, patients complete computerized self-assessments of validated clinical measures. The CMI uses Research Electronic Database Capture (REDCap), a free (but not open-source) secure Web application for building and managing online surveys. We designed a custom reporting module for individual patient reports to be available immediately at the point of care and an online aggregate reporting tool for clinical teams to track survey completion rates and outcomes. Clinical teams work closely with the CMI team to develop their CMI program/survey tools but receive no additional resources to accomplish survey administrations. We calculated descriptive statistics of admission and discharge survey administration and developed qualitative information about implementation “lessons learned” based on discussions with clinical teams that have implemented the CMI as part of the ongoing evaluation and monitoring of the program.

    Results: Over 20 programs representing 11 clinical psychiatric subpopulations have implemented the CMI to date; over 9000 episodes of care have been completed. Two programs (inpatient units) were unable to sustain the CMI in a way they found useful for clinical care and discontinued. Across active programs, 92% of admissions had admission assessments completed within 3 days of admission; 61% of discharges included a survey administration within 3 days of discharge. Clinical programs varied in the ability to successfully implement and sustain the CMI (eg, 69% of active CMI programs had >70% of admissions with admission surveys completed; over half accomplished >90% of admission surveys). Having at least one clinical champion at each program was a key driver for successful implementation. Champions served several needs: problem-solving successful new workflows, generating team enthusiasm, and setting team expectations for the importance of integrating the CMI information into clinical care. Teams that integrated the CMI into their clinical care with patients were also more successful in sustaining the CMI program.

    Conclusions: Achieving electronic patient reported outcomes measurement in intensive treatment psychiatric settings using REDCap and custom reporting tools is feasible but more easily accomplished in residential and partial hospital levels of care (compared to inpatient), where patient acuity is high but less severe and lengths of stay are longer. Clinical champions play critical roles in successful implementation and maintenance of electronic patient reported outcomes measurement and can be successful independent of program level of care or patient acuity.

    iproc 2016;2(1):e45



    This poster was presented at the Connected Health Symposium 2016, October 20-21, Boston, MA, United States.

    Edited by T Hale; submitted 05.06.16; peer-reviewed by CHS Scientific Program Committee; accepted 02.08.16; published 30.12.16

    ©Alisa Busch, Andrew Laband, Alex Kos, Thomas Weigel. Originally published in Iproceedings (, 30.12.2016.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in Iproceedings, is properly cited. The complete bibliographic information, a link to the original publication on, as well as this copyright and license information must be included.