Background: Electronic health records (EHRs) can improve communication processes but unique vulnerabilities remain. Failure to follow-up abnormal test results (“missed results”) is a key preventable factor in diagnostic delays in the VHA and often involves EHR-based communication breakdowns. Our work, as well as data from root cause analyses and malpractice claims in the VA, highlights many technical and “social” (i.e., workflow, organizational, people, and policy) variables that affect test results communication and follow-up. Objectives: We will develop and evaluate a new program for surveillance and improvement of test results- related diagnostic safety. This will include development, implementation, and evaluation of a change package (i.e., a catalogue of strategies, change concepts, and action steps that guide participants in their improvement efforts15) that identifies and addresses risks that predispose health systems to missed test results. Unique features & Innovation: In a 2017 National Quality Forum report “Improving Diagnostic Quality and Safety”, several measurement concepts related to test results follow-up were proposed for further development. We developed and tested a novel electronic indicator system of triggers for missed test results, which uses automated methods to find patients meeting specific criteria using Corporate Data Warehouse (CDW) data. Triggers are signals that can identify patients at higher risk of harm and alert providers to review records for potential patient safety events. Our team has used triggers to identify specific data patterns to facilitate selective chart reviews. We have achieved reasonable positive predictive values (PPVs) and negative predictive values (NPVs), and aim to have these tools used at the system level to measure care delays more efficiently. This measurement system has the potential to become a near real-time surveillance system to identify patients whose test results might have been missed. However, identifying safety deficits using triggers within the CDW is only the first step. For these reports to result in improvements, a team (clinical or organization-based) must analyze the data and create a feedback system to generate learning and improvements. Our change package aims to help VA facility-based teams implement a surveillance and improvement program, ensure that safety measurement will translate into action and help them create back-up systems to monitor diagnostic delays. Methods: Working with 2 operational partners (NCPS and VA Primary Care), our specific aims are: Aim 1: Develop and pilot test a “change package” (SAFER Change Package) to provide VA facilities guidance on how to implement a surveillance and feedback program related to missed test results. Aim 2: Evaluate if the “SAFER TRACKS” Intervention (SAFER Change Package delivered using a Virtual Breakthrough Series [VBTS] Collaborative supplemented with automated surveillance data on test results) can reduce missed results using a stepped-wedge cluster-randomized control trial. Our outcome measures will be the rate of missed test results, determined through random manual medical record review conducted nationally as part of the VHA performance-measurement system, as well as automated `trigger' indicators of missed test results. We hypothesize there will be fewer missed test results in participating sites during the SAFER TRACKS Intervention as compared to during the pre-intervention period. Aim 3: Evaluate the implementation of the SAFER TRACKS Intervention through mixed-methods in order to determine strengths and challenges at participating sites. Our outputs will include multifaceted socio-technical tools and strategies to help prevent, detect, mitigate, and ameliorate breakdowns in EHR-based communication that often lead to missed test results in the VHA. Significance: The project is responsive to “Targeted Solicitation for Health Services Research on Data and Measurement Sciences – A Learning Health Care System Initiative” and to HSR&D's Major Priority Domain of Healthcare Informatics and Sub-domain for innovative uses of information technology to improve diagnosis.
NIH Reporter Project Information
- Murphy DR, Giardina TD, Satterly T, Sittig DF, Singh H. An Exploration of Barriers, Facilitators, and Suggestions for Improving Electronic Health Record Inbox-Related Usability: A Qualitative Analysis. JAMA Network Open. 2019 Oct 2; 2(10):e1912638.
- Walter FM, Thompson MJ, Wellwood I, Abel GA, Hamilton W, Johnson M, Lyratzopoulos G, Messenger MP, Neal RD, Rubin G, Singh H, Spencer A, Sutton S, Vedsted P, Emery JD. Evaluating diagnostic strategies for early detection of cancer: the CanTest framework. BMC cancer. 2019 Jun 14; 19(1):586.
Treatment - Implementation, Technology Development and Assessment, TRL - Applied/Translational
Best Practices, Care Management Tools, Electronic Health Record, Guideline Development and Implementation, Surveillance
None at this time.