BACKGROUND/RATIONALE:
Increasingly, existing large datasets (such as the Geriatrics and Extended Care Data and Analysis Center [GEC-DAC] dataset) and prospective observational/quasi-experimental studies are being used to examine important research questions in seriously ill older adults and to explore new models of care delivery. Randomized controlled trials can be burdensome to seriously ill patients or infeasible to conduct, and they may not produce results generalizable to the population of interest. Observational data analyses in geriatric palliative care must account for severe treatment endogeneity, which occurs when factors are simultaneously associated with treatment likelihood and outcomes. Propensity scores are one way to address endogeneity. A propensity score is the estimated probability of treatment receipt, conditional on a set of observed covariates that are thought to be associated with both treatment likelihood and outcome. An unbiased treatment effect can be estimated by comparing treated and comparison individuals with similar propensity scores. Most guidance on propensity scores is restricted to methods for matching individuals with similar propensity scores across two groups (treatment, no treatment). Many treatments, however, have multiple levels, and restricting treatments to binary indicators obscures differences between groups. Weighting by propensity scores is a superior alternative to matching when there are multiple treatment groups. This study aims to develop best practices for using propensity scores for multimodal treatments and to strengthen researchers' abilities to use existing VHA data to improve health care value and efficiency for older veterans.

OBJECTIVE(S):
Specifically, this study will 1) use simulated data to determine which weighting/estimation combination (inverse probability weighting or kernel weighting by propensity scores estimated via regression with maximum likelihood estimation, covariate-balancing propensity score estimation, or generalized boosting methods) provides the most efficient estimates with the least bias in a variety of estimation scenarios, 2) determine which weighting/estimation strategy provides the best observed covariate balance (a secondary measure of propensity score performance) across multiple treatment levels in a variety of simulated estimation scenarios, and 3) determine which weighting/estimation strategy is the least susceptible to residual confounding.

METHODS:
Traditional Monte Carlo and plasmode (empirically based) simulations will be used to achieve the aims. To facilitate translation of results, we will repeat Aims 2 and 3 in empirical datasets with different sample sizes and expected treatment effect heterogeneity. Results will be verified by estimating effects of sedative-hypnotics on risk of in-hospital death in previously collected data from a study of 100,000 hospitalized veterans with cancer, heart failure, chronic obstructive pulmonary disease, and/or HIV/AIDS and from a study of 300,000 veterans with an opioid prescription.

FINDINGS/RESULTS:
Simulations and analyses are ongoing; no findings to report to date.

IMPACT:
We expect to identify patterns of superior performance for strategies in common estimation scenarios as well as scenarios in which inferences are most likely to diverge. We will develop training materials based on our results and work with an advisory committee of leaders in observational data analysis to disseminate these results widely and inform studies of non-randomized health care interventions (such as post-hospitalization referral to Geri-PACT) as well as studies using VHA "big data" resources. Throughout and after the study period, we will disseminate current best practices to researchers and analysts throughout the VHA.

---

External Links for this Project

NIH Reporter

Grant Number: I01HX002237-01A1
Link: https://reporter.nih.gov/project-details/9291340

---

PUBLICATIONS:

Journal Other

1. Garrido MM. Robust Evaluations of Intensive Care Unit Length of Stay Using Observational Data. [Letter to the Editor]. Journal of palliative medicine. 2018 Mar 1; 21(3):280. [view]

DRA: Aging, Older Veterans' Health and Care, Cancer, Lung Disorders
DRE: Treatment - Observational, Treatment - Implementation, TRL - Applied/Translational
Keywords: Outcomes - Patient, Practice Patterns/Trends, Statistical Methods
MeSH Terms: none