Talk to the Veterans Crisis Line now
U.S. flag
An official website of the United States government

VA Health Systems Research

Go to the VA ORD website
Go to the QUERI website

IIR 14-345 – HSR Study

IIR 14-345
Incorporating Treatment Outcomes into Quality Measurement of Depression Care
Paul N Pfeiffer, MD MS
VA Ann Arbor Healthcare System, Ann Arbor, MI
Ann Arbor, MI
Funding Period: April 2016 - September 2020
Depression affects an estimated one million Veterans Health Administration (VHA) patients each year and is a leading cause of disability and suicide death. There are several effective treatments for depression, including antidepressant medications and psychotherapy, yet the degree to which these treatments improve depression symptoms in clinical settings depends on the quality of care provided. Current VHA quality measures for depression mostly emphasize care processes, such as the number of days of medication dispensed or the number of psychotherapy sessions attended. However, comprehensive quality measurement should also include assessments of the clinic structures (e.g., staffing) that enable effective care processes and whether the ultimate goal of care-improved patient outcomes-is achieved. Incorporating patient-reported outcomes into quality improvement is a health system priority and has recently been
recommended by the Institute of Medicine.

Systematically collecting patient-reported outcomes in health care systems such as the VHA is challenging, particularly without burdening providers or introducing biases related to which patients receive follow-up assessments. This study will address these challenges by collecting depression symptom outcomes according to the Patient Health Questionnaire (PHQ-9) using an automated, telephone-based interactive voice response (IVR) system. PHQ-9 data collected across clinics in VISN 10 will be used to develop and test clinic-level outcome quality measures (OQMs). OQMs, after case-mix adjustment for differences in clinic patient populations, will allow determination of the structure and process measures (including a new measure of treatment intensification) associated with outcomes. Findings will enable leaders to identify under-performing clinics and the key aspects of care to address in order to achieve better depression outcomes for patients.

1) Develop and assess outcome quality measures for depression from PHQ-9 and case-mix adjustment data collected by an automated IVR system 2) assess the relationships between outcomes and care processes, including a new measure of treatment intensification, and 3) determine the association between facility characteristics (i.e., structures of care) and depression care processes and outcomes.

This prospective longitudinal study will sample 2,500 VHA patients from 50 primary care and mental health clinics in VISN 10. Included patients will have a clinical diagnosis of a depressive disorder and a PHQ-9 score >10. Patient characteristics (including duration of symptoms and socio-demographic factors) at baseline and PHQ-9 scores at 6 weeks, 12 weeks, 26 weeks and one year post-diagnosis will be collected via IVR. IVR data will be merged with health system electronic medical records of comorbid diagnoses, health system encounters, and pharmacy use. Threats to validity of IVR-based OQMs will be assessed by the
percentage of enrolled patients who complete a 12-week PHQ-9 (i.e., response rate) and by predictors of call completion (i.e., response bias). Case-mix adjusted multilevel models will be used to determine reliability according to the intraclass correlation coefficient. OQMs will be defined as the clinic-level residuals in these models. Clinic-level residuals indicate an individual clinic's performance in comparison to the expected performance for the average clinic. The validity of current VHA depression care process measures (e.g., 84
days of antidepressant medication supply, 8 psychotherapy visits within 14 weeks) and a new measure of treatment intensification will be assessed by determining their association with depression outcomes at the individual and clinic-level. The association between care structures (e.g., mental health staff-to-patient ratios, travel distance to clinic) and outcomes will similarly be examined, and separate models will examine the association between structures and care processes.

No findings to report at this time.

An estimated 19.5% of Veterans Health Administration (VHA) patients are affected by depression, a leading cause of disability and suicide. Antidepressant medications and psychotherapy are effective treatments for depression, but the degree of benefit depends on the quality of care. Current VHA quality measures of depression care are limited to particular care processes (e.g., number of psychotherapy visits), whereas a comprehensive approach to measuring quality should include an assessment of the structures of care (e.g., appropriate staffing) and whether improvement in patient-reported outcomes (e.g., depression symptoms) are achieved. This study establishes methods for generating reliable outcome-based quality measures of depression care using an IVR system. The care structures and processes related to outcomes will then be determined. Study findings may directly benefit patients by identifying clinics with poorer than expected outcomes and which care structures and processes should be addressed to improve outcomes.

External Links for this Project

NIH Reporter

Grant Number: I01HX001755-01A1

Dimensions for VA

Dimensions for VA is a web-based tool available to VA staff that enables detailed searches of published research and research projects.

Learn more about Dimensions for VA.

VA staff not currently on the VA network can access Dimensions by registering for an account using their VA email address.
    Search Dimensions for this project


Journal Articles

  1. Saulnier KG, Panaite V, Ganoczy D, Kim HM, Zivin K, Hofer T, Piette JD, Pfeiffer PN. Depression symptom outcomes and re-engagement among VA patients who discontinue care while symptomatic. General hospital psychiatry. 2023 Oct 14; 85:87-94. [view]
  2. Denneson LM, Trevino AY, Kenyon EA, Ono SS, Pfeiffer PN, Dobscha SK. Health Coaching to Enhance Psychological Well-being Among Veterans with Suicidal Ideation: a Pilot Study. Journal of general internal medicine. 2019 Feb 1; 34(2):192-194. [view]
  3. Vance MC, Wiitala WL, Sussman JB, Pfeiffer P, Hayward RA. Increased Cardiovascular Disease Risk in Veterans With Mental Illness. Circulation. Cardiovascular quality and outcomes. 2019 Oct 1; 12(10):e005563. [view]
  4. Panaite V, Bowersox NW, Zivin K, Ganoczy D, Kim HM, Pfeiffer PN. Individual and neighborhood characteristics as predictors of depression symptom response. Health services research. 2019 Jun 1; 54(3):586-591. [view]
  5. Sripada RK, Hoff R, Pfeiffer PN, Ganoczy D, Blow FC, Bohnert KM. Latent classes of PTSD symptoms in veterans undergoing residential PTSD treatment. Psychological Services. 2020 Feb 1; 17(1):84-92. [view]
  6. Vance MC, Chang MM, Sussman JB, Zivin K, Pfeiffer PN. Predicting clinically significant response to primary care treatment for depression from electronic health records of veterans. Journal of affective disorders. 2021 Nov 1; 294:337-345. [view]
  7. Levine DS, McCarthy JF, Cornwell B, Brockmann L, Pfeiffer PN. Primary Care-Mental Health Integration in the VA Health System: Associations Between Provider Staffing and Quality of Depression Care. Psychiatric services (Washington, D.C.). 2017 May 1; 68(5):476-481. [view]

DRA: Mental, Cognitive and Behavioral Disorders
DRE: Treatment - Observational
Keywords: Depression, Quality Improvement
MeSH Terms: none

Questions about the HSR website? Email the Web Team

Any health information on this website is strictly for informational purposes and is not intended as medical advice. It should not be used to diagnose or treat any condition.