|
1999 HSR&D Annual Meeting Abstracts
1. Are We Improving the Quality of Nursing Home
Care: The Case of Pressure Ulcers?
DR Berlowitz, MD, MPH. HSR&D Field Program CHQOER,
Bedford, MA. HQ, Bezerra, GH Brandeis, JJ Anderson
Objectives: Despite recent initiatives to improve nursing
home care, widespread concerns regarding nursing home quality persist and it is unknown
whether care is improving. Large databases describing nursing home residents are now
becoming available. We use two such databases to determine whether risk-adjusted rates of
pressure ulcer development have changed over time in two large, national providers of
nursing home care, the VA and a private, for profit chain.
Methods: We used the Patient Assessment File (PAF) to study VA
nursing homes from 1990 through 1997, and the Minimum Data Set (MDS) to study the private
nursing home chain from 1991 to 1995. Information from after 1995 was unavailable due to
the switch to version 2 of the MDS. Rates of pressure ulcer development were calculated
for successive six-month periods by determining the proportion of initially ulcer-free
residents having a stage 2 or larger pressure ulcer on subsequent assessments. Rates were
risk-adjusted for patient characteristics using previously developed models specific to
each setting. The proportion of new ulcers that were deep (stages 3 or 4) were also
calculated for each period.
Results: We examined risk-adjusted rates of pressure ulcer
development based on 274,919 observations of VA nursing home residents, and 144,379
observations of residents from the private chain. Between 1990 and 1995, rates of pressure
ulcer development declined by over 25% in both systems (p<0.05). Additionally, the
proportion of new ulcers that were deep declined in the private chain from 30% to 22%
(p<0.01). Beginning in 1996, though, VA risk-adjusted rates of ulcer development
increased to levels similar to those in 1990. The proportion of new ulcers that were deep
also increased from 40% before 1996, to 45% afterwards (p=0.01).
Conclusions: Significant improvements have occurred in the
quality of nursing home care between 1990 and 1995. Further studies are required to
understand why these improvements were not sustained in the VA.
Impact: These results demonstrate how large databases may be
used to monitor the quality of nursing home care over time. Despite concerns over nursing
home quality, our results are reassuring in that improvements have occurred. However,
pressure ulcer preventive care in the VA should be reexamined.
HSR&D Funded: IIR 95-031
2. Variations in Condition-Specific Health Status
Among VA General Internal Medicine Clinics
Stephan Fihn, MD, MPH, and Mary McDonell, MS. Northwest
Center for Outcomes Research in Older Adults, Seattle, WA.
Objectives: Recent efforts to improve quality of care and
productivity have involved measurements of patients' general health status to adjust
for case-mix and assess outcomes. Measures of health status, such as the SF-36, however,
may be too general to identify important differences in health and function among patients
with specific medical conditions. We compared variability in general and
condition-specific measures of health status among patients from a geographically diverse
sample of VA primary care clinics.
Methods: As part of the Ambulatory Care Quality Improvement
Project, we surveyed 38,642 active, eligible patients in 7 VA General Internal Medicine
Clinics. Baseline data collected on respondents included an inventory of active medical
conditions, including a depression screen (MHI5), and a demographic survey. Respondents
were then mailed the SF-36 and condition-specific health status measures for any of six
target conditions reported. Measures included the Seattle Angina Questionnaire (SAQ) and
the Seattle Obstructive Lung Disease Questionnaire (SOLQ). Patients with a positive MHI-5
were mailed the SCL-20, a measure of depression.
Results: Sixty-six percent of patients responded to the baseline
inventory. The mean age was 64 years, and 96% were male. Of the 24,287 patients who were
mailed follow-up SF-36 and condition-specific surveys, 15,007 (62%) responded.
Statistically and clinically significant differences among sites were observed on all
SF-36 scales including Physical Function (range 38.9 to 58.6), General Health (36.1 to
54.4), Vitality (33.8 to 50.5); Bodily Pain (44.7 to 61.3). Significant but smaller
variation was observed on scales of social and mental health. The relative differences
among sites were consistent across scales and approximated a full standard deviation
comparing the highest and lowest sites. Of 9004 patients who reported angina on the
initial questionnaire, 5697 (63%) returned the SAQ. Highly significant differences among
sites were also observed for scores on all SAQ scales including Anginal Frequency (69.4 to
80.5), Anginal Stability (50.6 to 64.4) and Physical Function (43.5 to 55.6). Of 5553
patients who reported COPD, 3302 (59%) returned the SOLQ. Again, highly significant
differences among sites were present for all scales including Coping (59.8 to 70.7),
Emotional function (51.1 to 65.5) and Physical Function (51.8 to 61.6).
Conclusions: Although potentially limited by response bias,
these results suggest there are clinically important differences among primary care
patients in different geographic locations with regard to both general and
condition-specific health status for chronic stable angina and COPD.
Impact: Differences in health status among primary care patients
in different locations must be taken into account when comparing outcomes and quality of
care. These results indicate that substantially more research is required to understand
and address these differences.
HSR&D Funded: SDR 96-002
3. Patient Preferences in PSA Screening: The Impact
of Shared Decision-Making Videos
EG Wilkins, MD, JC Lowery, MHSA, PhD, and JB Hamill, MPH. VA
Center for Practice Management and Outcomes Research, Ann Arbor, MI.
Objectives: VHA has recognized the need for a more
patient-oriented approach to the delivery of healthcare, including sharing responsibility
for medical decisions between providers and patients. Previous research has shown that
shared decision-making (SDM) may result in a variety of benefits, including improvements
in patient satisfaction and clinical outcomes. SDM programs have involved the use of
educational materials, primarily videotapes, to encourage patients to actively participate
in their healthcare. Although initial assessments of these approaches have been
encouraging, randomized clinical trials (RCTs) are lacking for most SDM interventions. Our
study used an RCT design to assess the impact of a standardized video program for patients
considering Prostate Specific Antigen (PSA) screening.
Methods: Male patients eligible for PSA testing were recruited
from five VA outpatient clinics and randomized to either SDM video or non-video groups.
Prior to meeting with their primary care provider, those in the SDM group viewed a PSA
video from the Foundation for Shared Medical Decision-Making. The control group received
information (verbally and in writing) traditionally used by the participating centers for
PSA test candidates. Following the provider meeting, patients in both groups were
administered written questionnaires ascertaining their decisions to undergo or decline PSA
testing. Consisting largely of previously validated instruments, the surveys also
evaluated patients' overall satisfaction with care; knowledge about PSA testing;
decision-making and information-seeking preferences; and decisional conflict. Comparisons
of categorical variables between the two groups were performed using chi-square analysis,
while continuous variables were analyzed using t-tests.
Results: A total of 91 patients were randomized to either SDM
(n=43) or control (n=48) groups. While no significant differences between the two groups
were noted in age, race, or marital status, the control group reported a significantly
higher educational level than the SDM group (p=0.04). Fewer SDM patients chose to undergo
testing (59.5%) compared with controls (80.4%) (p=0.099). SDM patients were more satisfied
with both the information received (p=0.08) and their levels of input into the testing
decision (p=0.07). Furthermore, the SDM group demonstrated significantly greater knowledge
about PSA testing compared to the control patients (p=0.0001). Both groups expressed a
strong desire for information; but SDM patients expressed significantly greater
preferences for active participation in the PSA decision (p=0.0075). Finally, in spite of
assuming larger roles in medical decision-making, SDM patients did not report
significantly higher levels of anxiety or uncertainty surrounding their decisions.
Conclusions: VA patients want information to help them make
decisions about their healthcare. Implementation of a video-based SDM protocol for
patients considering PSA screening appears to result in significantly greater knowledge
and preferences for active decision-making roles. These findings contradict reports by
Ende and others (1989) who found that older, less educated patients prefer less
information and participatory roles.
Impact: Our findings have important implications for designing
and implementing patient-centered care in VHA. Patients want and need information to help
them make decisions about their healthcare. SDM videos offer a means of conveying the
results of outcomes research in a way that patients can understand and use to make
decisions consistent with their preferences and values.
4. Effectiveness of VA Primary Care Firm Systems:
Preliminary Findings
Elizabeth Yano, PhD, Mingming Wang, MPH, Lisa Rubenstein, MD,
MSPH. Center for the Study of Healthcare Provider Behavior, Sepulveda, CA.
Objectives: As a healthcare delivery model, firm systems have
been associated with improved prevention, continuity and coordination. By 1996, many VA
facilities had launched firm "like" primary care delivery models, with little
information about the relative effectiveness of the variations being used. We assessed the
relative performance of VA firm systems in contrast with non-firms in terms of preventive
and chronic disease care and patients' satisfaction with continuity and coordination.
Methods: In 1996, a national VA expert panel operationally
defined a VA firm system through a modified Delphi process that examined the relative
importance and contribution to the suggested effects of firms of each of 30 proposed
features. Survey items based on these features were incorporated into a 50-item
organizational survey, pilot tested and fielded in June 1996 among all VAMCs nationwide. A
VAMC was classified as having a firm system if they had 1+ interdisciplinary primary care
teams with patients indefinitely assigned to a primary care provider who was responsible
for care from clinic-to-ward. We used these survey results (100% response rate) to
evaluate the performance associated with VA firm systems using baseline chart-based data
from the VHA External Peer Review Program and 1996 VHA National Customer Feedback Center
patient satisfaction data. We compared performance associated with firms vs. non-firms and
among alternate firm system specifications using the Kruskal-Wallis test.
Results: Overall, 35 (21.9%) VAMCs had firm systems. Compared to
non-firms, VA firms served fewer patients (p<.05), but achieved higher proportions of
patients who reported having a primary care provider (76.4% vs. 71.3%, p<.05).
Preventive practices were higher in firms vs. non-firms (Prevention Index .79 vs. .74,
p<.05), with specific benefits in alcohol counseling and colon-cancer screening
(p<.05). The Chronic Disease Index scores were also higher among firms (.87 vs. .82,
p<.05), with higher performance of sensation exams and foot pulse checks among
diabetics, and exercise counseling among hypertensives and obese patients (each p<.05).
On average, patients reported slightly fewer problems with continuity (.24+/-.12 vs.
.28+/-.10, p=.08). VA firms were more likely to have specialty referral and notification
policies (p<.01). The subset of firms with randomized patients and providers and the
larger set of firms without inpatient-outpatient continuity had few performance benefits
in contrast.
Conclusions: VA healthcare facilities adopting firm systems as
their primary care delivery model have higher proportions of patients who report having a
primary care provider, provide more preventive care, and higher quality of care for
selected chronic conditions. Patients were only marginally more satisfied with their
continuity of care. More research is needed to understand the key ingredients of effective
delivery models to support the continued growth and development of VA primary care
delivery systems, including the adoption of managed care practices, especially as they
relate to interdisciplinary teams of providers.
Impact: This work will support the planning and design of VA
primary care delivery systems that are associated with higher facility performance.
HSR&D Funded: MPC 97-012
5. Do Patients with Mental Disorders
"Unnecessarily" Use More Medical Services? Policy Implications for Mental Health
Capitation
CS Hankin, PhD, A Spiro III,PhD, and D Miller. Bedford VA
Medical Center, Bedford, MA. D Mansell,MD, MPH. Assistant Professor, Birmingham, AL
LE Kazis, ScD, Bedford VA Medical Center, Bedford, MA.
Objectives: It is commonly believed that patients with mental
disorders "unnecessarily" use high rates of medical services; the objective of
the present study was to explore this assumption. We examined patterns of medical services
use among VA ambulatory care patients who screened positive for depressive,
alcohol-related, or posttraumatic stress (PTSD) disorders. We hypothesized that even with
adjustment for age and medical disease comorbidity, patients who screened positive for
targeted mental disorders would have higher rates of medical services use that those who
did not screen positive.
Methods: Baseline data were obtained from the Veterans Health
Study, a longitudinal investigation of the health of 2,425 Boston-area, male VA ambulatory
care patients. Screening measures were CES-D for depression, CAGE for alcohol-related
disorder, and PCL-C for PTSD. Prior medical services use (number of inpatient stays in the
prior 12 months, and emergency room visits, outpatient visits, or telephone contact with
medical personnel in the prior 3 months) was assessed by self-report. The Disease Burden
Index (DBI; Kazis et. al., 1998) was used to adjust for medical comorbidity. We compared
unadjusted means between groups using t-tests. We then used general linear modeling to
compare means, adjusting for age and DBI.
Results: In unadjusted analyses, patients screening positive for
depression reported significantly more inpatient stays (1.86 vs. 1.53), outpatient visits
(4.80 vs. 3.15), and telephone contacts (2.53 vs. 1.83); following adjustment for age and
medical comorbidity, only the significant difference in number of inpatient stays (1.78
vs. 1.58) remained. Prior to adjustment, patients screening positive for alcohol-related
disorder reported significantly more inpatient stays (2.16 vs. 1.57), fewer emergency room
visits (1.20 vs. 2.12), outpatient visits (3.36 vs. 3.78), and telephone contacts (2.05
vs. 2.15); however, with adjustment, differences in number of inpatient stays (2.02 vs.
1.58) and outpatient visits (2.56 vs. 3.85) remained significant, but differences in
number of emergency room visits and telephone contacts no longer met statistical
significance. Prior to adjustment, patients screening positive for PTSD reported
significantly more inpatient stays (1.82 vs. 1.59), emergency room visits (2.47 vs. 1.66),
outpatient visits (4.76 vs. 3.46), and telephone contact (2.88 vs.1.88); following
adjustment, differences in medical services use were no longer significant.
Conclusions: Although unadjusted analyses of medical services
use revealed clear effects of the screening presence of mental disorders on most outcomes,
after adjusting for age and medical comorbidity, many of these effects no longer met
statistical significance.
Impact: Our findings have particular relevance for private
sector managed care organizations, where restrictions on mental health benefits
("capitation") serve to reduce adverse selection of patient with mental
disorders who are assumed to be poor risk because they "unnecessarily" use high
rates of medical services. Our findings do not support the notion of such a discrete or
direct relationship between mental disorders and medical services use. Results suggest
that capitation strategies which are based upon the presumed relationship between mental
disorders and medical services use should reconsider the important contributions of age,
comorbid medical disorders, and specific mental disorder diagnoses.
HSR&D Funded: SDR 91-006
6. A Comparison of VA to Public Sector Mental Health
Patients: the Connecticut Outcomes Study
Rani Hoff, PhD, Robert Rosenheck, MD, M Sernyak, J Steiner, S Atkins.
VA Connecticut Healthcare System, West Haven, CT.
Objectives: This paper presents results from a study comparing
mental health service delivery to seriously mentally ill patients at three institutions: a
VA hospital and two local community mental health centers operated by the State Mental
Health Agency (SMHA). The objective was to compare mental health care delivered in VA to
those services delivered to a socio-demographically similar population in community mental
health centers.
Methods: A random sample of 600 patients with serious mental
illness were taken from the three institutions (200 at each) and interviewed about their
clinical status, service use, satisfaction with services, and needs and barriers to care.
Results: VA patients were older, less likely to be non-white,
had higher incomes both from entitlements and other sources, had fewer problems with
housing, and were more satisfied with their housing. They also received significantly more
medical care, particularly outpatient medical care, than did SMHA patients, even after
controlling for age and medical conditions. There were no differences in the severity of
mental health symptoms or use of inpatient mental health care across the three sites.
However, VA was less community oriented in its outpatient mental health care: VA patients
were less likely to have received case management and rehabilitation services, were more
likely to be receiving individual therapy and medication management from a psychiatrist,
and were less likely to be taking atypical antipsychotics. These differences persisted
after controlling for severity of symptoms, age, race, marital status, income, and
education.
Conclusions: We conclude that the integrated medical system in
VA affords veterans better access to needed medical services; that the VA in Connecticut
has successfully moved away from a focus on inpatient mental health care; but that VA has
not made a complete transition to community oriented mental health care.
Impact: The impact of this research highlights the advantages of
an integrated medical system in ensuring veterans' access to all types of health care.
However, it also indicates that mental health treatment in VA has not been completely
translated to a community-oriented model.
HSR&D Funded: PPR 94-002
7. Comparing Quality of Mental Health Care in Public
Sector and Privately Insured Populations: First Efforts and Methodological Challenges
Douglas Leslie, PhD and Robert Roseheck, MD. VA Connecticut
Healthcare System, West Haven, CT.
Objectives: Comparing quality of care between large health care
systems is methodologically difficult, but is an important challenge to health care system
management. This study demonstrates methods for measuring quality of mental health care
and compares a sample of VA and privately insured patients using these measures.
Methods: Using discharge abstracts, we identified individuals
receiving inpatient mental health care in VA during the first six months of each fiscal
year 1993 to 1995. A similar cohort of privately insured individuals was identified using
MEDSTAT's MarketScan database. These individuals were tracked for six months following
discharge and length of stay, readmission rates, and access to outpatient services were
calculated. Means of these variables, adjusted for patient characteristics, were compared
over time and between the two populations.
Results: The private sector outperformed VA with respect to most
of the quality measures, although these differences were modest in magnitude and are
likely explained by the fact that VA patients are generally more severely ill and far more
socially disadvantaged. However, readmission rates increased considerably over time in the
private sector, whereas they declined among VA patients. The outpatient measures improved
in both systems, with VA improving more on the number of outpatient visits after discharge
and the private sector improving more with respect to the number of days to the first
outpatient visit after discharge. VA outperformed the private sector with respect to the
continuity of care measure in each year. Quality measures varied by diagnosis, with VA
performing better relative to the private sector in treating patients diagnosed with
substance abuse and mental health disorders not elsewhere classified, but performing
relatively worse in treating patients belonging to the depression diagnostic groups.
Unfortunately, variables describing income, disability and homelessness were not available
to adjust for major differences between patients treated in the two systems.
Conclusions: Although the private sector outperformed VA to a
modest degree with respect to these quality measures (with the exception of continuity of
care), VA improved markedly over time compared to the private sector, especially with
respect to the inpatient quality measures, and treats a more troubled population for which
adjustment was not possible.As these systems continue to adopt strategies to reduce the
costs of care and as government systems are increasingly compared to their private sector
counterparts, methods for comparing and evaluating the quality of care delivered become
increasingly important, although methodological challenges, as illustrated here, are
substantial.
Statements: This study provides a benchmark for quality of
mental health care in VA as efforts are made to reduce costs. Although similarities in
these quality measures between VA and the private sector are impressive (especially given
the fact that VA treats a more severely ill population), this study shows that there is
room for improvement.
8. Comparing Reimbursement Models for VA Mental
Health Services
Douglas Leslie, PhD, Robert Rosenheck, MD, Rani Hoff, WD White.
VA Connecticut Healthcare System, West Haven, CT.
Objectives: VA funding mechanisms have historically relied on
previous utilization as a basis for distributing funds, and have been criticized as
rewarding inefficient provision of care. In response to such criticisms, there is a desire
to base these funding mechanisms entirely on patient characteristics. This study explores
the impact of using various reimbursement models based on two patient classification
schemes - a functional assessment measure (the GAF) and clinical diagnosis - to distribute
funds for VA mental health care across VISNs.
Methods: We identify a cross-sectional sample of veterans
treated in specialty mental health clinics during a two-week period in fiscal year (FY)
1991. Data from the Patient Treatment File, Outpatient Care File, and the Cost
Distribution Report were combined to calculate total utilization and costs for this sample
during FY 1991. We then simulate hypothetical reimbursement amounts for these patients
based on five different reimbursement models: 1) reimbursement based on average total cost
per capita (average cost), 2) reimbursement based on average total cost by GAF score
(GAF-based), 3) reimbursement based on average total cost by diagnosis (diagnosis-based),
4) outpatient care reimbursed based on average overall outpatient costs and inpatient care
reimbursed based on average inpatient costs by GAF score (GAF-based inpatient), and 5)
outpatient care reimbursed based on average overall outpatient costs and inpatient care
reimbursed based on average inpatient costs by diagnosis (diagnosis-based inpatient).
Total simulated reimbursement by VISN for each of these models was then compared to actual
resource utilization.
Results: The distribution of funds nationally across VISNs
changes substantially as a result of our reimbursement models compared to actual
expenditures. The percentage of total VA expenditures redistributed across VISNs as a
result of our models ranges from 6.86% for the diagnosis-based reimbursement model to
8.29% for the simple average cost reimbursement model. However, using functional or
diagnostic measures resulted in only small changes from simple average cost capitation.
The effects on individual VISNs were substantial and consistent across reimbursement
models, with some VISNs experiencing an increase in funding of over 30% and others
experiencing a decrease of almost 22% in some simulations.
Conclusions: Reimbursement mechanisms based on functional
measures could have a substantial impact on funding patterns compared to current regimes,
although they make only minor changes compared to a simple average cost capitation rate.
Ideally, one would like to base the distribution of funds on the inherent costs of
treating patients in the VA system. Our use of GAF scores and diagnoses is a step in the
right direction, but these measures are probably imperfect bases for classification and
predicting costs because they are based on clinician judgement and are vulnerable to rater
bias.
Impact: These preliminary analyses demonstrate the application
of simple, readily available clinical classification schemes to reimbursing VA mental
health care. Further analyses are underway to elucidate the strengths and weaknesses of
this approach.
9. Impact of Primary Care Satellite Clinics on
Access to General Health Care Services and Mental Health Services
Robert Rosenheck, MD. VA Connecticut Healthcare System, West
Haven, CT.
Objectives: This study sought to determine whether the
establishment of community-based primary care clinics (CBOCs) facilitate access to general
health care and/or mental health care services, in both the general population and among
people with disabling mental illness.
Methods: From the last quarter of FY 1995 through the third
quarter of FY 1997, the Department of Veterans Affairs established thirty-four new
community-based primary care clinics in underserved areas. Data were obtained from the
1990 Census on the number of veterans residing in each US county. Data were also obtained
from VA's computerized workload data bases (the Patient Treatment File and the Outpatient
Care File) on the number of veterans residing in each US County who used VA health and
mental health services In FY 1995, before the clinics were established and FY 1997 and
used to determine the proportion of veterans in each county who used VA health and mental
health services. Analysis of Covariance was used to compare changes from FY 1995 - FY 1997
in use of VA services in counties in which new primary care clinics were located and in
other US counties, adjusting for potentially confounding factors such age distribution,
race and gender composition, and income distribution.
Results: Counties in which new clinics were established in late
1995-6 showed an increase in the proportion of veterans who used general VA health care
services that was almost twice as large as that observed in comparison counties (2.3% vs
1.3%; F=4.94; df=1,3117; p=.03). However, introduction of these clinics was not associated
with greater use of specialty VA mental health services in the general veteran population;
or of either general health care services or mental health services among veterans who
received VA compensation for psychiatric disorders. Interaction analysis showed that CBOCs
had their greatest impact on VA service use in counties with larger proportions of low
income veterans (beta = 0.006; F=2.11; df=1,3019; p=.03) and had less of an impact in
counties with a high proportion of hispanics (beta=-.35; F=2.20; df=1,3019; p=.02).
Conclusions: Community-base primary care clinics successfully
improve access to general health care services but do not improve access to specialty
mental health care for either the general population or for people with serious mental
illness.
Impact: In part as a result of this study, the Under Secretary's
Special Committee on Treatment of Seriously Mentally Ill Veterans recommended that
specialty mental health staff be included in planning of future CBOCs and the
Undersecretary has approved the recommendation.
HSR&D Funded: PPR 94-002
10. Corticosteroid Utilization and Outcomes in HIV
Associated Pneumocystis Carinii Pneumonia: Three-fold Higher Mortality among Severely Ill
Patients when Corticosteroids given by CDC Guidelines
Charles Bennett, MD, PhD and TC,Ilraith. Chicago VA
Hospital, Chicago, IL.
Objectives: Experience with the management of Pneumocystis
carinii pneumonia (PCP) exploded with the onset of the AIDS epidemic. Anecdotal reports of
improved outcome when steroids were used as adjuncts to appropriate anti-microbial therapy
led to controlled trials demonstrating their efficacy.[Bozette S, NEJM] The CDC created
guidelines supporting adjunctive therapy with corticosteroids. PCP management during 1995
to 1997 was evaluated for variations in guideline adherence and outcomes.
Methods: Chart reviews from 7 states, 74 hospitals (66 non-VA
and 8 VA), and 1,660 empirically diagnosed or confirmed PCP cases.
Results: 735 (44.2%) met CDC guidelines for adjunctive steroids
(Aa oxygen gradient > 35 mm Hg or p02 < 70 mm Hg) and 606 (82.4%) received steroids
as directed by the guidelines (w/in 3 days of anti-PCP medications). Higher rates of
appropriate steroid use were associated with African-American race/ethnicity (84%) versus
white (81%) or Hispanics (73%) (p=0.02), younger age (p=0.002), or receiving care in
Chicago or Seattle (90%) vs NY, Miami, or LA (71%) (p=0.001). Among severely ill patients
with Aa oxygen gradient > 53 mm Hg, 73% were confirmed PCP cases and 82% received
corticosteroids per the CDC guidelines. Among these patients, mortality rates were
three-fold higher for those who DID receive steroids (18% vs 6%, p=0.02). Similar findings
were noted for severely ill persons with confirmed PCP (17% vs 6%). In addition, receiving
PCP prophylaxis was associated with higher mortality rates (30% vs 16%, p=.001).
Conclusions: Adherence to CDC guidelines for adjunctive
corticosteroid use varied according to city and patient sociodemographics. More
importantly, improved outcomes seen in randomized controlled trials were not realized in
practice. Among severely ill PCP patients, mortality was three-fold higher when
corticosteroids were given according to CDC guidelines. Our findings suggest that the
utility of adjunctive corticosteroids in severe PCP needs to be revisited.
Impact: There was a three-fold higher mortality among severely
ill patients with associated Pneumocystis carinii pneumonia when corticosteroids were
given by CDC guidelines.
11. Use of Centralized VA Data Registry to Assess
Quality of HIV Care
Samuel Bozzette, MD, PhD and the HIV-QUERI Executive Committee.
Center for the Study of Healthcare Provider Behavior, San Diego, CA.
Objectives: To demonstrate the feasibility of extracting Quality
of Care data from the comprehensive longitudinal VA Immunology (HIV) Case Registry (ICR)
by assessing the use of newer "highly active" antiretroviral therapies among the
HIV-infected under VHA care.
Methods: The HIV-QUERI Coordinating Center was provided with
copies of the ICR. We identified unique patients and constructed ratios of the number of
patients and of total outpatient visits and hospital discharges, and prescriptions for
protease inhibitors or non-nucleoside reverse transcriptase inhibitors (PI-NNRTI). We
compared these values with national data on the population of adults under care from the
HIV Cost and Service Utilization Study (HCSUS).
Results: Approximately 11,000 unique HIV-infected patients were
seen at VA facilities each quarter from the 1st quarter of 1996 (1Q96), when PI-NNRTIs
were licensed, to the 4th quarter of 1997 (4Q97). Outpatient visits/100 patients
fluctuated from 769 in 1Q96 to 715 in 4Q96 to 851 in 4Q97. However, discharges/100
patients declined monotonically from 30 in 1Q96 to 24 in 4Q96 to 18 in 4Q97. The patterns
of use accompanied the rapid adoption of PI-NNRTI therapy in the VA as the percentage of
unique patients having at least one prescription written for a PI-NNRTI reached 62% by
4Q96 and 71% by 4Q97. The former compares favorably with estimates that 52 to 61% of all
HIV-infected adults under care in the US received the newer drugs in 12/96.
Conclusions: Newer antiretroviral therapies were adopted by VHA
providers and patients at least as quickly as by the general population. Increasing use of
these agents was accompanied by a dramatic decline in inpatient but not outpatient care.
Impact: Initial comparisons suggest that access of VHA patients
to newer HIV therapies is similar to that of other American adults, and that use of these
therapies is associated with a reduction in inpatient stays. The VA ICR database contains
important information on care for HIV. Improving the validity and accessibility of this
database is a high priority for the HIV-QUERI.
HSR&D Funded: HIV 98-000
12. The Prevalence of Hepatitis C in a Sample of
Severely Mentally Ill Veterans
Andrew Muir, MD and M Butterfield,. Duke University Medical
Center, Durham, NC. KG Meador, Hayden Bosworth, PhD. Durham VA Medical Center,
Durham, NC. K Stechuchak, and R Frothingham.
Objectives: There is a pressing need to study Hepatitis C
prevalence and risks in veterans including those with severe mental illness. The goal of
this study is to establish a prevalence estimate of Hepatitis C in severely mentally ill
veterans.
Methods: From March 1 1998- October 15, 1998 consecutive
patients admitted to the Durham VAMC inpatient psychiatric unit with a severe mental
illness (SMI) diagnosis were serotested for Hepatitis C. SMI diagnoses were defined as
meeting Diagnostic and Statistical Manuel of Mental Disorders fourth edition, (DSM-IV)
criteria for schizophrenia, schizoaffective disorder, bipolar disorder, or posttraumatic
stress disorder (PTSD).
Results: 146 SMI veterans were serotested during the study
period. Among these patients, 92.5% were male, 58.9% were African-American. The overall
proportion of hepatitis C in this sample of severely mentally ill patients was 17.8% (26
of 146). There was a trend for SMI African-Americans to have significantly higher
prevalence rates of Hepatitis C than for SMI Caucasians (24.42% vs. 9.62%). Among those
who tested positive for Hepatitis C, 42.3% were diagnosed with schizophrenia, 3.9% with
schizoaffective disorder, 7.7% with bipolar disorder, and 46.2% with PTSD.
Conclusion: SMI patients have substantially higher levels of
Hepatitis C than what has been reported in community samples. There is a significant trend
for SMI African-American patients to have higher Hepatitis C prevalence rates than
Caucasian persons with SMI. Positive Hepatitis C was most prevalent among veterans
suffering from schizophrenia or PTSD.
Implications: Hepatitis C is a potential epidemic among
veterans, including those with severe mental illnesses. Veterans with severe mental
illness who are infected with Hepatitis C may increasingly rely on the VA health system
for care with substantial cost implications. Further studies are necessary to determine
potential Hepatitis C risk factors for SMI persons who are particularly vulnerable to
Hepatitis C. Racial differences in Hepatitis C among SMI veterans may exist and warrant
further exploration. Increased risk behaviors (intravenous drug and alcohol use) and
increased social/contextual risks (community violence poverty, and trauma) have been
associated with race/ethnicity and may impact on Hepatitis C and associated risks.
Research directed toward understanding Hepatitis C prevalence, transmission, risks, and
progression in severely mentally ill veterans is essential.
CSP Funded: EPP 97-022 "HIV Seroprevalence and Risks in
Veterans with Severe Mental Illness
13. Management of Hepatitis C at the VA Puget
Sound Health Care System
Therese Dawson, BMED. VA Puget Sound Health Care System
Seattle, WA.
Objectives: Hepatitis C virus (HCV) infection is emerging as a
major health concern in the veteran population. Reports suggest up to 85% of those
infected will develop chronic hepatitis and 20% of these will develop cirrhosis. While the
prevalence in the VA patient population is estimated to be 10 times that of the general
community there appears to be no uniform approach to the management of HCV. Although
recent guidelines may help clarify HCV treatment several factors may impede their
implementation. The aims of this study were to review the management of patients diagnosed
with HCV at the VA Puget Sound Health Care System (VAPSHCS) in 1996 and identify factors
influencing this management.
Methods: A retrospective, systematic analysis was made of
medical, pathology and pharmacy records of all patients diagnosed with HCV in 1996 at the
VAPSHCS. Patients were followed through to May, 1998. Data collected included
demographics; diagnostic tests for HCV; history of drug and alcohol abuse; history of HIV,
HAV and HBV (testing and status); frequency and results of liver function tests; the
presence of concomitant liver disease; HCV notation in discharge summaries; hospital
attendances; Gastroenterology referrals; liver biopsies and alpha interferon treatment.
Descriptive statistics were performed where appropriate.
Results: One hundred and twenty seven patients were diagnosed
with HCV in 1996, 125 males and 2 females (mean age 46 years). Four died during the study,
3 from liver disease. Infection with HCV was detected by ELISA in 119 (94%) and confirmed
by PCR in 15 (12%), (RIBA not available). Eight patients (6%) had only PCR results
recorded. A history of intravenous and alcohol abuse was recorded in 89 (70%) and 68
(53%), respectively. Thirty-nine patients were tested for HIV (2 positive), 93 for HAV IgM
(all negative) and 110 for HBV (70 previous exposure, 3 chronic disease). Liver function
tests were performed at HCV diagnosis in 121 patients (95%) of which 63 (52%) were
abnormal. Of these, 42/121 (33%) had no subsequent LFTs. Hepatic cirrhosis was recorded in
10 (13%) and hepatocellular carcinoma in 2. Of 149 admissions among 84 patients HCV was
recorded in 98 (66%) of their discharge summaries. Twenty-seven patients (21%) have been
referred to Gastroenterology and 11 have undergone liver biopsy. Treatment with alpha
interferon was commenced in 9 patients.
Conclusions: This review provides an insight into current
managementpractices of HCV in our veteran population. Although it is limited by the
accuracy and completeness of records and data extraction some conclusions may be drawn.
The diagnosis and management of HCV infection at the VAPSHCS lacks uniformity and
direction with only 12% of patients receiving confirmatory PCRs. Even once diagnosed, 5%
of patients did not have LFTs performed and despite a high incidence of abnormality, a
further 33% have not had LFTs repeated. Few patients are referred to Gastroenterology and
fewer receive alpha interferon treatment. That HCV has a low profile among health care
providers is demonstrated by its lack of inclusion in the discharge summaries of 34% of
patients.
Impact: Hepatitis C infection is over represented in the veteran
population. Despite its associated morbidity and mortality HCV appears to have a low
profile at the VAPSHCS. Although new treatment guidelines have been proposed it is
unlikely that these will have significant impact on patient care if an active program for
raising the profile of HCV and organizing and centrally implementing them is not
established.
14. Hepatitis C Virus Infection and Addiction
Disorders in Department of Veterans Affairs Facilities Nationwide
Gary Roselle, MD, and Marta RENDER, MD. VA Medical Center,
Cincinnati, OH. SM Kralovic, LH Danko, and LA Simbart.
Objectives: An association exists between Hepatitis C Virus
(HCV) infection and addiction disorders (AD), such as illicit injection drug use,
inhalation of cocaine, and alcohol ingestion. Alcohol use is of special importance since
data suggest an accelerated progression to cirrhosis, and perhaps, hepatocellular
carcinoma. This investigation was designed to quantify the extent of comorbidities of
documented AD in persons testing positive for HCV antibody (HCVAb).
Methods: The DVA has implemented a national automated electronic
surveillance tool (Emerging Pathogens Initiative [EPI]) to extract information from VHA
local facility computer systems. The EPI program first identifies persons with a
laboratory test positive for HCVAb. Once identified, data are automatically extracted,
including demographics such as age, gender, era served, race/ethnicity, and ICD-9-CM coded
diagnoses for inpatients. At the Austin Automation Center data are converted to SAS format
for analysis by the Infectious Diseases Program Office. Each patient was only counted
once, even if the HCVAb test was positive on multiple occasions. AD for inpatients were
defined by ICD-9-CM codes and included: Alcohol Only, Cocaine Only, Tobacco Only, Other
Drugs Only (including barbiturates, amphetamines, narcotics, etc.), and combinations of
these diagnoses. Data were collected from 9/97 - 7/98 (11 months). Statistical analysis
used the chi-square test.
Results: Over 11-months, 22,676 persons were identified with a
positive test for HCVAb. Mean age was 48.51 (+9.03 SD); 2,021 (8.9%) were noted as
homeless; 21,811 (96.5%) were male. 15,981 (70.5%) were outpatients, 6,695 (29.5%) were
inpatients; 41% were identified as White, 28.6% Black, and 6.6% Hispanic; 2.6% of
inpatients with HCVAb died. 54.2% of inpatients with HCVAb had an ICD-9-CM code for an
alcohol-related diagnosis. Any cocaine and any other drug ICD-9-CM diagnoses were seen in
30.5% and 35% of patients who had HCVAb, respectively. 27.9% of persons who were HCVAb
positive had no documented AD. HIV infection was seen in 3.7% of inpatients with HCVAb.
81.6% of HCVAb positive persons were from the Vietnam or post-Vietnam era.
Conclusions: 54.2% of inpatients with a positive test for HCVAb
had an ICD-9-CM diagnosis related to intemperate use of alcohol, a substance associated
with greater severity of HCV-related liver disease. The AD seen in approximately 72% of
the patients are often associated with risk behavior for transmission, such as sharing
equipment for illicit injection drug use or inhalation of cocaine, and sexual risk
behavior. AD in patients with HCV infection will be challenging to provision of the
continuum of care; treatment regimen will require complex drug combinations with the need
for close follow-up, presenting major obstacles to mitigation of disease.
Impact: The VHA has identified a large population of HCVAb
positive persons, creating an inevitable patient care (>22,000 patients to date) and
financial (up to 750 million dollars) burden. AD were common, including intemperate
alcohol use. Intervention strategies must include VHA data driven targeted screening of
risk populations (IL 10-98-013), providing treatment and education for those currently
infected, and, most importantly, emphasize prevention of risk behavior that leads to
transmission.
HSR&D Funded: DEV 97-032
15. Mortality after Cardiac Bypass Surgery:
Prediction from Administrative versus Clinical Data
Jane Geraci, MD, MPH, Howard Gordon, MD, ML Johnson, Nancy
Petersen, PhD, L Shroyer, Nelda Wray, MD, MPH. Houston Center for Quality of Care and
utilization Studies, Houston, TX.
Objectives: To determine whether the administrative data
contained in the VA Patient Treatment File (PTF) can adjust for patient severity and
identify hospital mortality outliers identical to severity adjustment and outlier
identification using clinical data from a primary data collection, the Continuous
Improvement in Cardiac Surgery Program (CICSP).
Methods: We developed logistic regression models to predict
operative mortality following cardiac bypass surgery (BYPASS) in 15,288 veterans who
underwent bypass from 10/93-3/96. Two models were developed: one from PTF data and one
from the CICSP data. Observed-to-expected (O/E) ratios for operative mortality in each of
43 hospitals performing BYPASS were calculated, and hospitals were identified as outliers
if the 90% confidence interval for their O/E ratios did not include 1.0. Hospital outlier
status was compared for the O/E ratios calculated from each of the 2 logistic models.
Because the PTF model and CICSP models did not identify the same hospitals as outliers,
clinical variables from the CICSP data set were added, in stepwise fashion (entry
criterion pú0.1), to the PTF model to determine whether it could be "enriched"
to equal the CICSP model in outlier assignment. Both the PTF and the CICSP models were
developed on 2/3 of the study population and validated on the remaining 1/3.
Results: The PTF and CICSP models had comparable predictive
power (c statistics=0.767 and 0.760, respectively). The PTF model identified 3 of 6 CICSP
high outliers and 1 of 4 CICSP low outliers, plus 2 unique high and 3 unique low outliers.
Two additional CICSP variables added to the PTF model resulted in identification of 4 of 6
high and 2 of 4 low outlier hospitals; addition of other CICSP variables increased the PTF
modelÆs predictive power (final c statistic=0.811) but did not further improve outlier
identification.
Conclusions: PTF data have predictive power for BYPASS operative
mortality. Addition of a few clinical variables improved the PTF modelÆs hospital outlier
assignment, but differences between the PTF and the CICSP model in this performance
remained.
Impact: Administrative data have an ability to predict operative
death following BYPASS that is comparable in predictive power to that of clinical data.
The comparable predictive power yet unique hospital outlier identification suggests that
the PTF model and CICSP model adjust for different things. The addition of a small number
of clinical variables not currently available in the PTF improved its ability to detect
hospital outliers, as measured against the CICSP data.
HSR&D Funded: 95-005
16. The Houston Approach to Optimal Risk-Adjustment
Using Administrative Data
Howard Gordon, MD, Jane Geraci, MD, MPH, ML Johnson, Nancy
Petersen, PhD, L Shroyer, and Nelda Wray. Houston Center for Quality of Care and
Utilization Studies, Houston, TX.
Objectives: To develop a comprehensive risk adjustment that
takes full advantage of the data available in an administrative database.
Methods: We analyzed 15,288 veterans who underwent cardiac
bypass surgery (BYPASS) in the Department of Veterans Affairs (VA) between 10/93-3/96,
using data from the Patient Treatment File (PTF), the administrative data base on
inpatient hospitalizations maintained by the VA. Data included death within 30 days of
BYPASS, age, date of surgery (weekend versus other), ancillary procedure performance
before or on the day of surgery (coronary angioplasty or intraortic balloon pump (IABP)),
and the ICD-9-CM principal and up to 9 comorbid diagnosis codes. Diagnoses identified as
possible complications of BYPASS were not used for risk-adjustment. The frequency of
post-operative death for principal and comorbid diagnoses was ascertained in a
developmental set of FY92-93 BYPASS cases. Principal diagnoses that occurred in 30 or more
cases were coded individually. Less frequent principal diagnoses were grouped together
into a "rare principal" variable. Comorbid diagnoses were ranked in five groups
by risk of death, for codes occurring in at least 30 cases. Less frequent comorbid
diagnoses were grouped together into a "rare" group. Patients without any
comorbid diagnosis codes were placed into another group. Stepwise logistic regression was
used to choose important independent predictors of death within 30 day of BYPASS. In
addition, we explored whether a count of comorbid conditions had independent predictive
power, and whether a count within each of the comorbidity groups was predictive. The model
was developed on 2/3 of the study sample and validated on the remaining 1/3. Data are
presented from the full study sample.
Results: Eight independent predictors of postoperative death
were identified: age, weekend surgery, angioplasty on the day of surgery, IABP before or
on the day of surgery, and 4 variables representing principal or comorbid diagnoses. Two
principal diagnosis codes were protective against operative death: angina pectoris (413)
and "other forms of chronic ischemic heart disease" (414). A count of the
comorbidities within the group having the lowest mortality rate in the developmental set
also was protective. Having any comorbidity from the rare group increased the risk of
postoperative death. The model c statistic=0.767, Hosmer-Lemeshow goodness-of-fit
statistic=4.4 (p=0.82).
Conclusions: Administrative data have moderate ability to
predict operative death following BYPASS. Even in a homogenous group of patients
undergoing the same surgical procedure the principal medical diagnosis influenced the risk
of death, and should be handled separately from comorbid conditions. Some comorbid
conditions were more influential than others in predicting death, illustrating that a
unit-weighting of them does not accurately reflect their risk.
Impact: Administrative data have moderate ability to predict
operative death following BYPASS. Even in a homogenous group of patients undergoing the
same surgical procedure the principal medical diagnosis influenced the risk of death, and
should be handled separately from comorbid conditions. Some comorbid conditions were more
influential than others in predicting death, illustrating that a unit-weighting of them
does not accurately reflect their risk.
HSR&D Funded: 95-005
17. A Markov Model of Severity of Illness States
and Hospital Mortality
ML Johnson, W Chan, DH Kuykendall, and Carol Ashton, MD, MPH.
Houston Center for Quality of Care and Utilization Studies, Houston, TX.
Objectives: To model the course of hospitalization from
admission to discharge or death using a Markov model of illness severity states derived
from laboratory data.
Methods: Laboratory data was collected using the Health Summary
component of VISTA for 476 consecutive patients admitted with non-psychiatric principal
diagnoses to the general medicine section of the Houston VAMC. Laboratory test results
were scored to create APACHE-L severity of illness measures for each day of the hospital
stay that laboratory tests were conducted. Patients were classified into Low, Medium, or
High severity states based on the APACHE-L scores. A Markov chain is proposed to model the
transition of patients between severity states over the course of the hospital stay, until
reaching states of discharge or hospital death, defined as death in the hospital or within
30 days of discharge. A total of 12 possible transitions can occur from day to day: from
Low to Medium (LM), Low to High (LH), Low to Discharge (Ldisch), or Low to Dead (Ldead);
and similarly four each from Medium and High. A split sample technique was employed to
validate predictions of transition rates between severity states, and from severity states
to discharge or death.
Results: In the development sample, 44.5% of patients were
admitted in severity state Low (106/238), 46.2% in Medium (110/238) and 9.2% in High
(22/238). The overall hospital mortality rate was 9.2% (22/238), with a 3.8% mortality
rate occurring in patients admitted in Low state (4/106), 9.1% in Medium (10/110) and
36.4% in High (8/22). Median waiting times were 4 days in a Low state, 2 days in Medium
and 1 day in High. Example transition rates were: Ldisch 8.7%, meaning patients in a Low
state had a 8.7% probability of discharge the next day; Hdead 6.25%, meaning patients who
ever reach a High severity state faced a 6.25% chance of dying before the next day. Rates
were applied to the validation sample and accurate predictions were found, including:
149.55 expected discharges from Low state with 149 observed; 9.6 expected Hdead
transitions, 6 observed; and 5.8 Ldead transitions, 6 observed. Stationary transition
probabilities obtained from the limiting probability distribution were 6.1% deaths from
Low state, 9.0% Medium and 21.6% High for an entire course of hospitalization.
Conclusions: A Markov model can be constructed from laboratory
data to accurately predict transitions between severity of illness states and from
severity states to discharge or death. Waiting times indicate relatively quick departure
from High and Medium severity states, but relatively long stays in a Low severity state
before being discharged, with risk of becoming more ill or even dying.
Impact: Further research is needed to explore methods to use
results of Markov modeling as quality of care indicators. In addition to hospital
mortality rates, performance could be monitored on rates of improvement or worsening
during the course of hospitalization. To improve quality of patient care, a computerized
system could track severity states of patients daily to provide a synthesis of laboratory
data and risk of mortality to physicians.
18. Hospital Profiles of Mortality from Cardiac
Bypass Surgery: Effect of Definition of Outcome based on Administrative versus Clinical
Data
ML Johnson, JM Geraci, NP Wray, HS Gordon, MJ Petersen, AL Shroyer.
Houston Center for Quality of Care and Utilization Studies, Houston, TX.
Objectives: To determine whether using a definition of
post-operative mortality based on administrative data from the Patient Treatment File
(PTF) affects identification of hospital mortality outliers derived from a model of
post-operative mortality based on clinical data from a primary data collection the
Continuous Improvement in Cardiac Surgery Program (CICSP).
Methods: A sample of 15,288 patients from the CICSP data
collection who underwent cardiac bypass surgery from 10/93 to 3/96 were studied. The CICSP
defined post-operative mortality as any death occurring within 30 days of the operation,
or any post-surgical death attributable to surgical complication by medical peer review.
Post-operative death was defined using administrative data as any death occurring within
30 days of surgery. Agreement of the outcome variables defined by administrative data
versus clinical data was assessed. A logistic regression model was constructed to predict
the dependent variable, operative mortality, as defined by CICSP, using the CICSP clinical
data as independent variables in a backward stepwise selection (Model 1).
Observed-to-expected (O/E) ratios for operative mortality in each of 43 hospitals
performing bypass were calculated, and hospitals were identified as outliers if the 90%
confidence interval for their O/E ratios did not include 1.0. A second logistic model was
constructed using the same independent variables from Model 1, but substituting the
dependent variable with post-operative mortality as defined by the PTF to determine the
unique effect of the definition of outcome on hospital profiles (Model 2).= Hospital
outlier status was compared for the O/E ratios calculated from each of the 2 logistic
models.
Results: CICSP classified 557 patients as post-operative deaths,
and the PTF classified 498 as post-operative deaths. Sensitivity of the PTF definition to
the CICSP was 89.4% and specificity was 100%. Model 1 identified 6 hospitals as high
outliers and 4 hospitals as low outliers. Model 2 identified 5 high outliers, 3 of which
were original outliers, and 3 low outliers, 2 of which were outliers originally.
Conclusions: Agreement of classifications of post-operative
death was very high between administrative data and clinical data. However, using the
definition of death from administrative data resulted in 10.6% fewer patients classified
as a post-operative mortality, due to the inability of the administrative data to capture
post-30 day deaths attributed to the surgery by medical review. This discrepancy in the
definition of death further resulted in different hospitals being identified as outliers
than originally derived from clinical data alone.
Impact: Further research to examine the sensitivity of hospital
profiles to changes in outcome definition is needed to determine best use of both
administrative and clinical data. The PTF is a highly accurate source of identifying
post-operative death from cardiac bypass surgery overall; however, the administrative
database does not contain the clinical information to identify which post-30 day deaths
are due to surgical complications. Hospital profiles developed from clinical or
administrative models may differ because of differences in the definition of outcome even
when the independent variables are identical.
HSR&D Funded: IIR 95-005
19. Accuracy of Computer Identified Diagnoses in a
VA General Medicine Clinic
Herbert Szeto, MD, MPH and Mary Goldstein, MD. VA Palo Alto,
Palo Alto, CA.
Objectives: Many existing and proposed critiques of medical care
rely on DHCP diagnoses. Whereas the accuracy of VA inpatient diagnoses in VISTA/DHCP
versus charts have been well studied, little is known about the accuracy of outpatient
diagnoses. This study sought to examine the accuracy of diagnoses for
hypertension-relevant disorders recorded in DHCP when compared to the outpatient medical
record.
Methods: We undertook a cross-sectional chart review to assess
the accuracy of common medical diagnoses that may affect the choice of anti-hypertensive
therapy. Eight clinical conditions, asthma/COPD , atrial fibrillation, BPH, congestive
heart failure, coronary artery disease, diabetes mellitus, gastroesphogeal reflux disease
(GERD), hyperlipidemia, and hypertension were assessed in the general medical clinic at VA
Palo Alto. Charts of patients scheduled to one of the half-day clinics of 16 residents, 5
nurse practitioners (NPs) and 5 attending physicians (MDs) were reviewed for the week of
May 18-22, 1998. A half-day clinic schedule was chosen by convenience for MDs and NPs who
had more than one general medicine clinic that week. Clinic charts of 137 of the 148
scheduled established patients were available for review. A diagnosis was considered to be
present if it was listed either in the past medical history or as part of the problem list
for any past note in the clinic record. A list of diagnoses for each patient was then
obtained through DHCP and compared to diagnoses listed in the chart.
Results: The prevalence of the conditions varied from 5.1% for
CHF to 51.1% for hypertension. Using the outpatient record as the gold standard, the
sensitivity/specificity of DHCP for the conditions are as follows: asthma/COPD (.43/.96),
atrial fibrillation (.89/.97), BPH (.3/.95), congestive heart failure (.57/.97), coronary
artery disease (.57/.98), diabetes mellitus (.77/.95), GERD (.58/.97), hyperlipidemia
(.73/.88), and hypertension (.74/.79). The specificity of DHCP was generally greater than
.95, but was as low as .79 for hypertension. The positive predictive value for a diagnosis
listed in DHCP varied from .50 for BPH to .89 for CAD. One of the limitations of this
study is that patients were chosen through scheduled appointments with specific providers.
As is typical of university affiliated VA clinics, our clinics are staffed by resident and
staff physicians. Since resident physicians have clinic scheduled only once a week, the
sample was disproportionately shifted toward patients cared for by residents. Moreover,
the patient population may be biased toward patients with a greater number of medical
problems, who seek medical attention more frequently. Coding of diagnoses for these
patients may be less complete since providers are less likely to list secondary diagnoses
related to any one visit.
Conclusions: This pilot study suggests that significant
discrepancies may exist between clinic records and the DHCP system. Diagnoses were often
omitted from DHCP, and some diagnoses present in DHCP were not present in the clinic
record.
Impact: As we move into an era where electronic clinical
databases may be used to assess quality, risk adjust, or as a basis for automated
treatment recommendations, careful attention must be paid to the accuracy of such data.
20. Prostate Cancer Quality of Life and Outcomes
Research among Patients with Low Socioeconomic Status: An Overview of the VA Cancer
of the Prostate Outcomes Study (VA CaPOS)
Simon Kim, MPH. Chicago, VA Hospital. SJ Knight, E Moran, CN
Robertson, and JE Smith. Charles Bennett, MD, PhD. Chicago VA Hospital, Chicago, IL.
Objectives: Outcomes assessment for prostate cancer are
important, because of debates over the benefits and costs of alternate treatments and
outcomes. Because of a lack of evidence of survival benefits with specific therapies,
quality of life (QOL) evaluations have taken on increased importance. QOL is rarely
assessed among racial/ethnic minorities and men of lower socioeconomic status, who make up
a disproportionately large part of the prostate cancer burden. We have initiated the first
multi-center QOL outcomes study of lower socioeconomic status men, the VA Cancer of the
Prostate Outcomes Study (VA CaPOS).
Methods: VA CaPOS QOL information is collected from prostate
cancer patients, spouses, and physicians at six VA medical centers. Because of low rates
of literacy, interviewers assess QOL, involvement in care, and the relative importance of
likely outcomes following alternative treatments. Spouses provide proxy ratings of patient
QOL. Physicians provide information on patients' performance status and the
patients' perceived preferences for alternate outcomes. Medical records and
electronic databases are reviewed for sociodemographic characteristics and relevant
clinical characteristics.
Results: Currently, 601 men with prostate cancer are included in
the VA CaPOS, over half of whom are African American. The mean time since diagnosis was
1.4 month for newly diagnosed patients and over 4 years for the rest. QOL responses were
most favorable for newly diagnosed, intermediate for stable metastatic disease, and
poorest for progressive metastatic disease patients, most of whom had been followed for
several years. Spouse emotional well-being assessments were significantly worse than those
of individual patients. While patients were not able to provide reliable estimates of
their own preferences for future QOL states, they were able to respond reliably to
questions phrased as a comparison of the preferences of two hypothetical patients. While
African American prostate cancer patients were more likely to have advanced stage disease
at the time of diagnosis, after adjustment for differences in health literacy, race was no
longer a significant predictor of having advanced prostate cancer.
Conclusions: The VA CaPOS provides useful information on health
status, QOL, and low literacy for VA prostate cancer patients. Our results indicate that
valid and reliable assessments in low literacy populations are feasible, but that
long-term evaluations are needed to detect clinically meaningful information on QOL as the
disease progresses. Alternative sources of QOL information, such as spouses, provided
results that had poor concordance for emotional and social functioning, but were generally
valid for other dimensions of health. The reliability of patient ratings of future QOL
states was increased when questions were based on two hypothetical friends rather than
consideration by the patients themselves of two potential, but different, future health
states. Observational database efforts are potential sources of important information for
lower socioeconomic status patients who are faced with difficult therapeutic decisions,
limited financial resources, and concerns over both quantity and quality of life outcomes
with alternative therapies.
Impact: VA CaPOS provides useful information on health status,
QOL, and low literacy for VA prostate cancer patients. It also provides useful information
about spouse proxy ratings of patient QOL.
21. Prevalence of Lower Urinary Tract Symptoms and
Associated Resource Utilization among VA Primary Care Patients
Elizabeth Yano, PhD, MSPH. VA Greater Los Angeles Healthcare
System, Sepulveda, CA. AB Lanto. Timothy Wilt, MD, MPH. VA Medical Center,
Minneapolis, MN. Lisa Rubenstein, MD MSPH. VA Greater Los Angeles Healthcare
System, Sepulveda, CA.
Objectives: In 1997, nearly 750,000 male veterans had outpatient
diagnoses of benign and malignant prostate disease, yet little is known about their
presenting symptoms in primary care or associated resource utilization, information that
would be useful in the design of programs to systematically screen and treat them. We
assessed the prevalence of lower urinary tract symptoms consistent with the presentation
of prostate disease among VA primary care patients and assessed their VA healthcare
utilization.
Methods: These data were drawn from a longitudinal cohort of
randomly sampled male veterans in no acute distress who were visiting the Primary
Ambulatory Care and Education (PACE) Center from March-June 1993. Using the Survey of
Health and Medical Care designed for the evaluation of PACE, a primary care firm system,
we conducted a telephone survey of 1,849 veterans with 3+ primary care visits regarding
their health status and symptoms. Lower urinary symptoms (e.g., nocturia) were queried
using items developed by a national panel of academic urologists. Cutpoints were selected
to identify the most clinically meaningful symptom burden. Survey data were linked with VA
administrative data to evaluate general medicine and subspecialty outpatient visits
(particularly urology), and admission rates during the following year. We used logistic
regression to evaluate the predictors of symptom burden among primary care patients.
Results: For specific symptoms, 24.4% of men reported
sometimes-to-frequently having urinary urgency (11.2% frequently), 12.1% reported
sometimes-to-often having problems urinating in the previous month (4.0% often), and 24.1%
reported urinating 1+ times/hour (4.4% >2 times/hour). Nearly half of those surveyed
(47.5%) reported that they urinated 2+ times/night (22.2% with 3+ trips), while over half
(56.2%)reported moderate-to-slow streams (11.2% slow and strained). Taking the most severe
category for each symptom, we found that 32.9% had 1+ clinically meaningful lower urinary
tract symptoms (21.0% with 1, 6.7% with two symptoms). As clinically expected,
hypertensives were 53% more likely to report 1+ symptoms (1.53, 95%CI 1.18-1.98),
diabetics were 75% more likely (1.75, 95%CI 1.32-2.31), and men reporting
shortness-of-breath at rest (1.80, 95%CI 1.28-2.52) or on exertion (2.03, 95%CI 1.49-2.77)
were more likely to report 1+ lower urinary tract symptoms (p<.0001). Adjusting for
these comorbid conditions, men with 1+ symptoms had significantly more general medicine
(p<.01) and urology visits (p<.00001) in the following year compared to men without
urinary symptoms. The more symptoms reported, the higher the general medicine (p<.005),
subspecialty (p<.0001) and urology (p<.0001) visit rates, as well as
medical-and-surgical admission rates (p<.0001).
Conclusions: Male primary care patients have a significant lower
urinary tract symptom burden consistent with underlying prostate disease that is
associated with significantly higher utilization of VA healthcare resources. Clinical
guidelines and pathways that address the optimal role of primary care practitioners and
urologists in a coordinated system of care are needed.
Impact: VHA has identified prostate disease as a high impact
target condition for QUERI. These analyses are helpful in quantifying the needs of
veterans and in assessing how to manage patients in primary and specialty care.
22. Relative Effectiveness of Androgen Suppressive
Therapies for Advanced Prostate Cancer
Timothy Wilt, MD, MPH. VA Medical Center, Minneapolis, MN. N
Aronson, J Seidenfeld, D Samson, V Hasselblad, and P Albertsen. Charles Bennett,
MD, Chicago, IL. PhD Alan Garber, MD. PhD. Center for Health Care Evaluation,
Palo Alto, CA.
Objectives: To determine the relative effectiveness of
alternative strategies for androgen suppression as treatment of advanced prostate cancer.
Methods: We conducted a systematic review of the evidence from
randomized controlled trials Options included monotherapy with surgical or medical
orchiectomy (diethlystibesterol, [DES], luteinizing hormone-releasing hormone [LHRH]
agonist, or antiandrogens) or combination therapy with additional suppression of adrenal
androgens (Combined Androgen Blockade) [CAB]. Three issues were addressed: (1) the
relative effectiveness of monotherapy (orchiectomy, DES, LHRH agonists, and
antiandrogens); (2) the effectiveness of CAB compared to monotherapy; (3) the
effectiveness of immediate androgen suppression for PSA rise compared to androgen
suppression deferred until clinical progression. Outcomes included overall,
cancer-specific, and progression-free survival; time to treatment failure; adverse effects
and quality of life.
Results: There are wide differences in costs of androgen
suppression: annual costs were DES = $109; LHRH agonists = $5,000; antiandrogens = $3500;
CAB = $8500; surgical orchiectomy per operation = $3000. Survival after treatment with an
LHRH agonist is equivalent to survival after orchiectomy or DES (Hazard ratio [HR] = 1.11;
95% CI= 0.89,1.39). The available LHRH agonists are equally effective regarding survival
and no LHRH agonist is superior to others when considering adverse effects. Survival may
be lower with use of a nonsteroidal antiandrogen (hazard ratio relative to orchiectomy =
1.22; 95% CI = 0.97, 1.54). There is no statistically significant difference in survival
at 2 years between patients treated with CAB or monotherapy (HR = 0.97; 95% CI=0.87,1.09).
Meta-analysis of the limited data available show a statistically significant difference in
survival at 5 years that favors CAB but this is of questionable clinical significance (HR
= 0.91; 95% CI = 0.85,0.99). Data suggest that monotherapy has fewer adverse events and
results in improved quality life. More men randomized to CAB (10%) withdrew from therapy
due to adverse events than men randomized to monotherapy (4%). There is no evidence from
randomized trials to compare early androgen suppression initiated upon PSA rise to
androgen suppression deferred until clinical progression. There was a significant
difference in 5-year overall survival in favor of androgen suppression initiated at the
time of radiation compared to radiation alone followed by androgen suppression initiated
at clinical progression (HR = 0.63; 95% CI = 0.48, 0.83; NNT at 5 years = 12).
Conclusions: Androgen suppression with orchiectomy or DES
provides equivalent survival at lower cost than LHRH agonist, antiandrogens or CAB.
Adverse events and quality of life favored monotherapy.
Impact: Androgen suppression for advanced prostate cancer with
orchiectomy or DES provides equivalent survival and quality of life compared to LHRH
agonists, antiandrogens or CAB. Treatment with orchiectomy or DES would result in
considerable cost savings. Despite widespread practice of initiating androgen suppression
for rising PSA levels in the absence of clinical signs or symptoms there is no evidence
from randomized trials comparing this strategy to androgen suppression deferred until
clinical evidence of disease progression. Patients who undergo immediate treatment will
have a longer duration of therapy in which they experience the adverse effects and
increased costs of androgen suppression.
23. Men's Beliefs about the Benefits of and
Professional Recommendations for PSA Screening
Judith Zemencuk MA, and Rodney Hayward MD. Center for Practice
Management and Outcomes Research, Ann Arbor, MI. SJ Katz
Objectives: Despite the many uncertainties surrounding
screening for prostate cancer, few published studies have examined men's beliefs about the
pros and cons of prostate-specific antigen (PSA) testing. This study assesses and
describes the beliefs men hold with regard to the benefits of, controversies about, and
professional recommendations for screening for prostate cancer by PSA testing.
Methods: Using a self-administered questionnaire developed to
measure men's knowledge and understanding regarding PSA testing, we collected data from a
sample of men seeking care at a VA medical center general medicine outpatient clinic or at
one of two primary care sites of its university affiliate. Of 390 consecutive men, 45
years or older, at the VA medical center site, 270 (69%) consented to participate and
returned completed questionnaires. At its university affiliate sites, 119 of the 162 (73%)
eligible patients completed questionnaires.
Results: Over 42% of all men reported that they had had a PSA
test, while 16% were unsure. Nearly 77%, however, indicated a desire for PSA testing
within the next year or two, including 75% of men 70 years and older (for whom the test is
not generally recommended even by screening advocates). In general, most men believed
regular PSA testing to be highly beneficial. For example, over 80% of all men thought that
medical studies have shown that regular PSA testing can reduce a man's chance of dying
from prostate cancer by 50% or more. Most men were unaware of the uncertainties
surrounding the use of PSA as a screening test. For example, although nearly half of men
reported reading or hearing reports about PSA testing, nearly two-thirds were unsure as to
whether there was a controversy among medical professionals concerning when and how often
a man should get regular PSA testing. Beliefs regarding recommendations for PSA screening
for men their age were inconsistent. For example, while 62% of all men thought that the
medical profession in general recommends that men their age get regular PSA testing, 46%
were unsure as to whether their own physician endorsed a similar recommendation. There
were no significant differences in responses at the VA vs. non-VA clinics.
Conclusions: Most men were uncertain as to whether screening for
prostate cancer by PSA testing is controversial, while a majority believed that PSA
testing is recommended by the medical profession in general. A substantial proportion of
men were uncertain as to whether their own physician recommended PSA testing. Still, a
large majority believed PSA testing to be substantially beneficial and wanted PSA
screening.
Impact: Uncertainties concerning the benefits of screening for
prostate cancer using prostate-specific antigen (PSA) have led many to suggest that men be
involved in the decision to screen. Indeed, the VA has mandated documentation of PSA
counseling. Our study's findings indicate that men may not have sufficient information to
make an informed decision regarding screening for prostate cancer by PSA testing and
highlight the need to improve men's knowledge and understanding of this screening test.
24. Preventing Urinary Tract Infection using
Urinary Catheters Coated with Silver Alloy: A Cost-Effectiveness Analysis
Sanjay Saint, MD, MPH. Center for Practice Management and
Outcomes Research, Ann Arbor, MI. DL Veenstra, SD Sullivan, C Chenoweth, and AM
Fendrick.
Objectives: Up to 25% of hospitalized patients have a
urinary catheter placed at some time during their stay. The overall incidence of
nosocomial urinary tract infection (UTI) among patients with an indwelling catheter is
about 5% per day. UTIs account for up to 40% of nosocomial infections, with bacteremia
complicating nosocomial UTI in about 4% of cases. A recent meta-analysis indicated that
silver alloy urinary catheters were efficacious in preventing UTI compared with standard
urinary catheters; however, providers must decide whether the efficacy of such catheters
is worth the extra cost of approximately $5 per catheter. We performed an analysis to
determine the incremental cost and the incremental incidence of catheter-related UTI,
bacteremia, and death associated with the use of silver alloy urinary catheters versus
standard urinary catheters.
Methods: The decision analytic model, performed from the
healthcare payer=92s perspective, was based on patients admitted to acute care hospitals
on general medical, surgical and urological services requiring indwelling urethral
catheterization between three and six days. Three interventions were compared: 1)
universal silver alloy catheter use; 2) silver alloy catheter use only in those at high
risk for catheter-related UTI, defined as patients not on systemic antimicrobials; and 3)
standard (non-coated) urinary catheter use in all patients. Outcome estimates were derived
from several quantitative syntheses of published reports. Cost estimates were based on
University of Michigan Health System costs and literature review. Sensitivity analyses
were performed and included scenarios in which estimates were set to favor either the
universal use of silver catheters or the universal use of standard catheters.
Results: In the base-case analysis, the strategy of universal
silver catheter use resulted in an expected cost savings of almost $6 per catheter
compared with universal standard catheter use and a 45% relative decrease in the incidence
of symptomatic UTI, bacteremia, and death. The strategy of targeted silver catheter use
resulted in cost savings of $3.75 per catheter used compared to universal standard
catheter use and an expected 20% relative decrease in symptomatic UTI, bacteremia, and
death. Sensitivity analyses across the reasonable range of outcome and cost estimates did
not dramatically alter these findings.
Conclusions: The results of our analysis indicate that
strategies using either universal silver catheters or targeted silver catheters in
patients requiring urinary catheterization between three and six days are cost-saving
compared to standard catheters and should reduce the incidence of symptomatic UTI,
bacteremia, and death. The appropriate use of silver catheters in patients requiring
catheterization for less than three days or more than six days remains unclear.
Impact: The universal use of silver alloy-coated urinary
catheters in patients requiring catheterization between three and six days should be
strongly considered. The base-case analysis suggests that for approximately every 1000
silver-alloy catheters used, an average of $6500 will be saved overall, and 9.7 cases of
symptomatic UTI, 1.7 cases of bacteremia and .2 deaths will be avoided.
25. HSR&D Development Center Workshop
Douglas D. Bradham, DrPH. HSR&D
Developmental Center, Capital VISN (5), Baltimore, MD.
Purpose: To provide an open discussion (from the trenches) of
key issues facing these Centers as they mature into HSR&D
infrastructure for their VISNs.
Objective A: To encourage interchange among the current (10)
HSR&D Developmental Centers by discussing their approaches to
several key issues including:
a) Attracting a critical mass of clinician investigators.
b) Training and mentoring these investigators toward successful LOIs
and IIRs.
c) Hiring talented staff in critical areas of:
i) VA Database extraction and programming.
ii) Biostatistics and methodologists.
iii) Health economists.
iv) Others?
d) Acquiring and holding on to space!
e) Maintaining linkage with R&D and VISN-level operational
concerns.
f) Gaining VISN-level financial support.
Objective B: To improve the next round of HSR&D Developmental
Center applications by discussing the current Centers' approaches to issues including:
i) Critical items in the proposals.
ii) Critical items in the organizational phase.
iii) Critical items in the implementation phase.
iv) Other critical items for success.
Approach: Each topic will be examined by the 10 directors along
characteristics of:
a) What works and why?
b) What does not work?
c) Who is helpful and why?
Activities: Each Developmental Center
Director will be asked to participate. Modifications in the issues listed above will be
generated. Prior to the Annual Meeting, each Director will be asked to lead a posting of
ideas for group contributions for a particular topic. The posting of ideas will be
recorded and a summary report will be assembled. That report will be made available for
the attendees and for HSR&D Headquarters staff for use in encouraging new applicant's
success.
Audience: Current and future of applicants for developmental
center funding.
Audience Familiarity: Individuals who are considering
application for Developmental Center funding should attend.
26. Internet-Based Education for Epidemiology
Michel A. Ibrahim, MD, University of
North Carolina at Chapel Hill, Chapel Hill, NC .
Abstract: This workshop is intended to
demonstrate the utility of Internet-based courses in basic and continuing education of
epidemiology. As an illustration, one module for an outbreak investigation will showcase
the technology and demonstrate the interactive and stimulating nature of this mode of
learning. A module is a self-contained unit of study that requires advanced readings and
consists of an audio tutorial and a review of a case study with a set of questions and
answers. An entire course consists of several related modules. You
need not to bring anything with you to benefit from this demonstration. However, if you
want to have a hands-on experience by actual participation you should bring a laptop with
Windows95, Intel Pentium, floppy drive, 16Mb of RAM, 16-bit sound card with headphones,
Netscape Navigator version 3.x or 4.x, RealAudio Player and CD-Rom drive. You may download
Netscape from http://home.netscape.com/ and RealAudio Player from http://www.real.com -
both these programs are free and are needed for the demonstration. No Internet link is
necessary during the demonstration. In order to be able to use the
technology effectively to complete an actual module or an entire course, the
"student" must have the skills and understanding of Internet jargon, Internet
navigation, discussion forums, listservs, and other related topics.
Target: The target audience includes The
Veterans Administration clinicians, researchers and administrators. The educational
offerings would vary in terms of the nature of topics covered as well as the degree of
complexity of content from the introductory to the advanced, depending on the particular
audience.
27. Using National VA Data in health Services and
Epidemiologic Research
Reiber, Gayle, PhD, MPH, and Jennifer MAYFIELD, MD, MPH. VA
Puget Sound Health Care System, Seattle, WA. Charles Maynard. Michael Chapko,
PhD, VA Puget Sound Health Care System, Seattle,
WA.
Objective: To describe and illustrate
basic considerations and strategies for use of national VA data in health services and
epidemiologic research.
Activities: In this workshop, participants
will have an opportunity to follow the steps involved in procuring data from national VA
databases. Two clinical examples will provide participants with an overview of the process
and specific methods used to obtain the data. The first example is
ô what was the prevalence of esophageal cancer in the VA from
1993-1997 and what was the survival experience of these patients? Ö The
second example is ô how many lower limb bypass and amputation
procedures were performed in VA hospitals between 1992 and 1996? Participants
will receive information on administrative and human subjects clearance, database
considerations, downloading strategies, sample programs for data extraction, and file
linkage and data quality considerations.
Target: Health services researchers with
no prior experience using national VA databases.
28. Continuity of Care as a Determinant of Patient
Satisfaction. Results from the ACQUIP Study
Marcia Burman, MD, Mary McDonell, MS, and Stephan Fihn, MD, MPH.
VA Puget Sound Health Care System, Seattle, WA.
Objectives: Patient satisfaction has been positively associated
with improved patient compliance and improved clinical outcomes and negatively associated
with malpractice claims. Factors that have been found to be related to patient
satisfaction include sociodemographic factors, payment source, both patient and physician
rated health status and utilization measures. We examined relationship between continuity
of care and patient satisfaction.
Methods: We surveyed 38,642 General Internal Medicine Clinic
(GIMC) patients followed at 7 VAs. Data gathered included demographics, active medical
problems and satisfaction with care using the Seattle Outpatient Satisfaction
Questionnaire (SOSQ) which measures satisfaction with humanistic and organization aspects
of care. Patients who reported angina, COPD, diabetes or hypertension also received
condition-specific questionnaires (e.g. the Seattle Angina Questionnaire and the Seattle
Obstructive Lung Disease Questionnaire) which include measures of condition-specific
satisfaction. All scales were scored from 0 (worst) to 100 (best). Patients were also
asked to rate their continuity of care.
Results: 14,865 patients responded with 11,711 reporting one or
more of the following disease conditions: angina (n=5544), COPD (n=3189), diabetes
(n=3249) or hypertension (n=8059). The percent of patients reporting seeing the same
provider "always", "most of the time", "sometimes", and
"rarely or never" were 38, 39, 14 and 6 respectively. There was no difference in
the distribution of continuity scores between the disease conditions. Mean scores on both
the SOSQ humanistic scale and condition-specific scales were strongly related to perceived
continuity of care with satisfaction scores ranging from 86.7 to 61.4 among veterans who
reported "always" seeing the same provider. Satisfaction scores among veterans
who reported "rarely or never" seeing the same provider ranged from 69.5 to 41.9
(p<.001). These findings persisted after adjusting for age, education, race, income, VA
facility, and length of time receiving care at the VA and SF-36 scores.
Conclusions: Continuity with the same provider is highly related
to Patients' general and condition-specific satisfaction.
Impact: Since higher patient satisfaction has been associated
with improved outcomes in chronic disease and improved medical compliance efforts to
improve patient satisfaction might be reasonable interventions for improving outcomes.
Further studies are needed to evaluate the contribution of various components of
continuity of care (for example convenience, access, ease of negotiating the system, etc)
to patient satisfaction.
HSR&D Funded: SDR 96-002
30. A Disease-Targeted Measure of Health-Related
Quality of Life (HRQOL) for Patients with Chronic Liver Disease the LDQOL 1.0.
Ian Gralnek,MD, MSHS. West Los Angeles VA Medical Center,
Los Angeles, CA. RD Hays, HR Rosen, EB Keeffee, DM Jensen, and P Martin.
Objectives: The development and validation of a
patient-centered HRQOL outcomes measure is timely and needed for individuals with chronic
liver disease. Disease-targeted measures can capture small, yet clinically meaningful
changes in patients' health status due to an intervention or disease progression that a
generic instrument may fail to detect. Therefore, the objective of this study is to
evaluate the psychometric properties (reliability and validity) of a newly developed
disease-targeted HRQOL instrument (the LDQOL 1.0) for individuals with chronic liver
disease.
Methods: Disease-targeted items in the LDQOL 1.0 were developed
from focus groups of patients with chronic liver disease awaiting liver transplantation,
expert hepatology panel input, and an extensive review of the literature. Cognitive
interviews were conducted to detect potential problems with instrument design or wording
of items. The HRQOL instrument was then constructed consisting of 36 generic items (SF-36)
supplemented with 77 disease-targeted items. A multicenter, cross-sectional field test was
conducted.
Results: 221 consecutive ambulatory adult patients being
evaluated for liver transplantation participated in this field test (64.1% male; median
age = 51 years (range 23-78 years); 68.9% white, 6.8% Asian/Pacific Islander, 3.9%
frican-American, 1.9% Native American, 18.5% other or multiracial). The LDQOL 1.0 is a
self-report measure that includes 21 multi-item scales (number of items): physical
functioning (10), role limitations-physical (4), pain (2), liver disease-related symptoms
(19), emotional well-being (7), role imitations-emotional (3), energy (4), cognitive
function (6), memory (4), concentration 3), hopelessness (7), loneliness (6), stigma of
liver disease (8), social function (2), quality of social interaction (5), sexual function
(3), sleep 6), general health perceptions (7), health distress (4), effects of liver
disease 9), and impact of liver disease (4). Internal consistency reliabilities
(Cronbach's alpha) ranged from 0.67 to 0.95 (median=0.86); 20/21 reliability estimates
were excellent, alpha >= 0.70. All 21 scales were significantly (p<0.05) associated
with self-reported severity of symptoms and 4 scales with duration of liver disease
(better HRQOL related to less severity and shorter duration of liver disease). Role
limitations-physical was most strongly related to severity of symptoms (p<0.01); sleep
was most strongly associated with duration of disease (p<0.05). Worse physical
functioning (p<0.01), worse sexual functioning among males (p<0.01), role
limitations-physical (p<0.01), more liver disease-related symptoms (p<0.05), and
greater negative effects of liver disease (p<0.05) were all significantly associated
with higher Child-Pugh class.
Conclusions: This multicenter study demonstrates the high degree
of reliability and construct validity of the LDQOL 1.0 for individuals with chronic liver
disease. This HRQOL outcomes instrument is able to measure significant impairment of daily
functioning not detected by more traditional clinician-rated methods (e.g., Child-Pugh
classification). The LDQOL 1.0 is now ready for implementation into prospective,
longitudinal studies.
Impact: 1. The LDQOL 1.0 will allow for a better understanding
of HRQOL in patients with chronic liver disease. 2. The LDQOL 1.0 fits well with the VHA's
initiative to build a system of data collection that will integrate both generic and
disease-targeted functional status instruments into a routine process of HRQOL data
collection. 3. HRQOL data collection in chronic liver disease will allow for case mix
comparisons, evaluation of changes in patient functional status over time and its
potential relationship to processes of care, and generation of patient summary information
for the clinician in their care of patients with chronic liver disease. 4. The LDQOL 1.0
may provide important information on resource utilization within the VA health care system
such as response to therapeutic interventions (e.g., therapies for chronic viral hepatitis
and liver transplantation).
31. Measuring the Job Satisfaction of Providers in
VA Primary Care: the Seattle Provider Satisfaction Questionnaire (SPSQ)
Mary McDonell, MS. VA Puget Sound Health Care System,
Seattle, WA. J Marshall. Stephan Fihn, MD, MPH. VA Puget Sound Health Care
System, Seattle, WA. KE Kilpatrick, and DS Lessler.
Objectives: Determining the satisfaction of health care
providers is critical given continual changes in organization and expectations that often
dramatically affect providers and influence their perceptions about their ability to
deliver high quality care. We developed and validated a survey to measure multiple
dimensions of job satisfaction among VA primary care providers.
Methods: Open-ended interviews designed to elicit provider
perceptions of organizational characteristics that contributed to work satisfaction were
conducted with 20 providers from a large group practice and VAPSHCS. Interviews and
published questionnaires were used to generate a prototype 78-item questionnaire. As part
of the Ambulatory Care Quality Improvement Project (ACQUIP) pilot study, the survey was
tested among 236 general internists at 8 facilities (VA and non-VA) and condensed to 50
items. The 50-item questionnaire has now been administered to 220 providers at 7 ACQUIP
sites and 792 providers at 56 VA facilities participating in the PRIME program. We
performed exploratory (EFA) and confirmatory factor analyses (CFA) to analyze
dimensionality of the SPSQ. Convergent and discriminate validity of the SPSQ were assessed
using CFA as an approximation of the multitrait-multimethod approach. ANOVA and linear
regression were used to examine subscale and global satisfaction scores and to adjust for
demographic characteristics. Scales were scored from 0 (least satisfied) to 100 (most
satisfied).
Results: The sample of 1012 providers was comprised of
physicians (69%), nurse practitioners (NPs) (22%) and physician assistants (PAs) (9%). 49%
were female. Ages ranged from 20-65 years; 40% were between 36 and 45. 77% were Caucasian,
12% Asian, and 4% African American. 44% had been at their jobs for >5 years. Six
dimensions (subscales) emerged from factor analysis and all demonstrated high internal
consistency: clinical staff communication (Cronbach's alpha=.86); relationships with
specialists (.89); hassle-free work environment (.89); patient characteristics (.77);
philosophy of practice (.84); and colleagues (.84). The CFA also demonstrated both
convergent and discriminant validity (p<.001). Mean scores for all scales were low:
staff communication (38.6); specialists (41.5); assle-free (37.7); patient characteristics
(49.3); philosophy (66.4); and colleagues (58.4). Subscale and global satisfaction scores
did not differ significantly according to gender, age, ethnicity, time on the job or
provider type (resident, staff MD, PA, NP). Comparing different VA facilities, there were
significant differences for all scales that were most dramatic (i.e., >25 points) for
philosophy and colleagues. When the six domains were entered into a regression model
predicting global satisfaction, the philosophy domain (belief in organization's philosophy
and ability to practice according to personal standards) accounted for 57% of the variance
(p < .001). Clinic organization and clinical staff communication were also
significantly related to overall satisfaction (p< .001).
Conclusions: The SPSQ is a reliable, valid measure of multiple
domains of provider satisfaction. The extent to which a provider's practice standards and
philosophy are aligned with the organizations is a key determinant of overall
satisfaction.
Impact: The SPSQ is potentially useful for monitoring outcomes
and evaluating changes in clinic organization.
HSR&D Funded: SDR 96-002
32. Patient Characteristics and Patterns of use of
Lumbar Spine Radiographs: Results from the Veterans Health Study
Alfredo Selim,, MD, MPH. Boston VA Medical Center, Boston,
MA. G Fincke. X Ren, PhD. Edith Nourse Rogers Memorial Veterans Hospital,
Bedford, MA. A Lee, and C Skinner. Lewis Kazis, ScD. Edith Nourse Rogers
Memorial Veterans Hospital, Bedford, MA.
Objectives: Understanding patient factors that affect patterns
of use of lumbar spine films |