Talk to the Veterans Crisis Line now
U.S. flag
An official website of the United States government

VA Health Systems Research

Go to the VA ORD website
Go to the QUERI website

IIR 15-438 – HSR Study

IIR 15-438
Improving the Measurement of VA Facility Performance to Foster a Learning Healthcare System
Laura A Petersen, MD MPH
Michael E. DeBakey VA Medical Center, Houston, TX
Houston, TX
Funding Period: June 2017 - September 2021
To develop a learning health care system (LHCS), VHA leadership must understand where quality improvement is needed via valid and actionable performance measurement and reporting. Current performance measurement and reporting systems focus exclusively on facility-level variability across diverse performance metrics. This approach assumes that facility-level variability is reliable and provides valid information for decision-making regarding performance improvement. Also, current methods of performance reporting may not be meeting the needs of VHA operational leaders for actionable information related to local variations in performance.

Our goal is to advance the science of multi-level health care performance measurement toward more actionable feedback about sources of variability in performance. To achieve this, we will (1) build an analytical model of inpatient outcomes and their predictors at multiple levels of the health system. We assert that variability in inpatient outcomes and predictors at the inpatient unit level will exceed corresponding variability at the facility level, and that unit- and facility-level service burden and resources will be predictors of clinical outcomes. We will also (2) present data in feedback reports targeted to front-line clinicians and administrators who can use the results to improve care quality.

For our first objective, we will build a multi-level structural equations model to simultaneously evaluate variation at the inpatient unit level and facility level. The study population includes all inpatient stays on acute care nursing units at VA acute care facilities. Inpatient outcomes include adverse events from the Inpatient Evaluation Center (IPEC) and readmissions calculated using patient data from the corporate data warehouse (CDW) and VA/CMS data from VIReC. Predictors of patient outcomes include measures of service-burden (average and total relative risk score and diagnosis-related group (DRG) index per unit per day) from CDW and Health Economics Resource Center, measures of resources (total hours worked by nurses per unit per day) calculated from payroll and staff data from Human Resources Information Services (HRIS), VA Time and Attendance System (VATAS), and Personnel and Accounting Integrated Data (PAID), and measures of nurse satisfaction from the National Center for Organization Development's (NCOD) All Employee Survey (AES). To achieve our second objective, we will conduct individual interviews with 5-6 key informants from each of five levels of VHA (national, network, facility, service line, and unit) and use qualitative data from these interviews to develop facility performance data display templates aligned with current science on feedback design. For each of the tailored set of templates, usability will be tested by 5 participants in 2-3 iterative rounds.

We have data for 2,524,350 subjects (patients and staff) from administrative datasets across 577 acute care nursing units in 122 facilities from FY 2015-2017. We constructed data crosswalks to support linking staff and patients to nursing units by date for AES, BCMA, and HRIS data.

Consistent with the initial submission, people throughout the VHA want to provide excellent care and desire the information and resources to make excellent care possible. Our goal is to provide valid information on performance and quality of care in reports targeted to front-line clinicians and administrators who can use this information to initiate appropriate change. By providing these necessary tools to those who deliver and distribute care to Veterans, we aim to enable continuous and effective quality improvement throughout the VHA.

External Links for this Project

NIH Reporter

Grant Number: I01HX002034-01A2

Dimensions for VA

Dimensions for VA is a web-based tool available to VA staff that enables detailed searches of published research and research projects.

Learn more about Dimensions for VA.

VA staff not currently on the VA network can access Dimensions by registering for an account using their VA email address.
    Search Dimensions for this project


None at this time.

DRA: Health Systems
DRE: Technology Development and Assessment, TRL - Applied/Translational, TRL - Development
Keywords: Clinical Performance Measures, Efficiency
MeSH Terms: none

Questions about the HSR website? Email the Web Team

Any health information on this website is strictly for informational purposes and is not intended as medical advice. It should not be used to diagnose or treat any condition.