These pages use javascript to create fly outs and drop down navigation elements.

HSR&D » Meetings » 1999
HSR&D Logo
  
Search HSR&D:

1999 HSR&D Annual Meeting Abstracts



1. Are We Improving the Quality of Nursing Home Care: The Case of Pressure Ulcers?

DR Berlowitz, MD, MPH. HSR&D Field Program CHQOER, Bedford, MA. HQ, Bezerra, GH Brandeis, JJ Anderson

Objectives: Despite recent initiatives to improve nursing home care, widespread concerns regarding nursing home quality persist and it is unknown whether care is improving. Large databases describing nursing home residents are now becoming available. We use two such databases to determine whether risk-adjusted rates of pressure ulcer development have changed over time in two large, national providers of nursing home care, the VA and a private, for profit chain.

Methods: We used the Patient Assessment File (PAF) to study VA nursing homes from 1990 through 1997, and the Minimum Data Set (MDS) to study the private nursing home chain from 1991 to 1995. Information from after 1995 was unavailable due to the switch to version 2 of the MDS. Rates of pressure ulcer development were calculated for successive six-month periods by determining the proportion of initially ulcer-free residents having a stage 2 or larger pressure ulcer on subsequent assessments. Rates were risk-adjusted for patient characteristics using previously developed models specific to each setting. The proportion of new ulcers that were deep (stages 3 or 4) were also calculated for each period.

Results: We examined risk-adjusted rates of pressure ulcer development based on 274,919 observations of VA nursing home residents, and 144,379 observations of residents from the private chain. Between 1990 and 1995, rates of pressure ulcer development declined by over 25% in both systems (p<0.05). Additionally, the proportion of new ulcers that were deep declined in the private chain from 30% to 22% (p<0.01). Beginning in 1996, though, VA risk-adjusted rates of ulcer development increased to levels similar to those in 1990. The proportion of new ulcers that were deep also increased from 40% before 1996, to 45% afterwards (p=0.01).

Conclusions: Significant improvements have occurred in the quality of nursing home care between 1990 and 1995. Further studies are required to understand why these improvements were not sustained in the VA.

Impact: These results demonstrate how large databases may be used to monitor the quality of nursing home care over time. Despite concerns over nursing home quality, our results are reassuring in that improvements have occurred. However, pressure ulcer preventive care in the VA should be reexamined.

HSR&D Funded: IIR 95-031

2. Variations in Condition-Specific Health Status Among VA General Internal Medicine Clinics

Stephan Fihn, MD, MPH, and Mary McDonell, MS. Northwest Center for Outcomes Research in Older Adults, Seattle, WA.

Objectives: Recent efforts to improve quality of care and productivity have involved measurements of patients' general health status to adjust for case-mix and assess outcomes. Measures of health status, such as the SF-36, however, may be too general to identify important differences in health and function among patients with specific medical conditions. We compared variability in general and condition-specific measures of health status among patients from a geographically diverse sample of VA primary care clinics.

Methods: As part of the Ambulatory Care Quality Improvement Project, we surveyed 38,642 active, eligible patients in 7 VA General Internal Medicine Clinics. Baseline data collected on respondents included an inventory of active medical conditions, including a depression screen (MHI5), and a demographic survey. Respondents were then mailed the SF-36 and condition-specific health status measures for any of six target conditions reported. Measures included the Seattle Angina Questionnaire (SAQ) and the Seattle Obstructive Lung Disease Questionnaire (SOLQ). Patients with a positive MHI-5 were mailed the SCL-20, a measure of depression.

Results: Sixty-six percent of patients responded to the baseline inventory. The mean age was 64 years, and 96% were male. Of the 24,287 patients who were mailed follow-up SF-36 and condition-specific surveys, 15,007 (62%) responded. Statistically and clinically significant differences among sites were observed on all SF-36 scales including Physical Function (range 38.9 to 58.6), General Health (36.1 to 54.4), Vitality (33.8 to 50.5); Bodily Pain (44.7 to 61.3). Significant but smaller variation was observed on scales of social and mental health. The relative differences among sites were consistent across scales and approximated a full standard deviation comparing the highest and lowest sites. Of 9004 patients who reported angina on the initial questionnaire, 5697 (63%) returned the SAQ. Highly significant differences among sites were also observed for scores on all SAQ scales including Anginal Frequency (69.4 to 80.5), Anginal Stability (50.6 to 64.4) and Physical Function (43.5 to 55.6). Of 5553 patients who reported COPD, 3302 (59%) returned the SOLQ. Again, highly significant differences among sites were present for all scales including Coping (59.8 to 70.7), Emotional function (51.1 to 65.5) and Physical Function (51.8 to 61.6).

Conclusions: Although potentially limited by response bias, these results suggest there are clinically important differences among primary care patients in different geographic locations with regard to both general and condition-specific health status for chronic stable angina and COPD.

Impact: Differences in health status among primary care patients in different locations must be taken into account when comparing outcomes and quality of care. These results indicate that substantially more research is required to understand and address these differences.

HSR&D Funded: SDR 96-002

3. Patient Preferences in PSA Screening: The Impact of Shared Decision-Making Videos

EG Wilkins, MD, JC Lowery, MHSA, PhD, and JB Hamill, MPH. VA Center for Practice Management and Outcomes Research, Ann Arbor, MI.

Objectives: VHA has recognized the need for a more patient-oriented approach to the delivery of healthcare, including sharing responsibility for medical decisions between providers and patients. Previous research has shown that shared decision-making (SDM) may result in a variety of benefits, including improvements in patient satisfaction and clinical outcomes. SDM programs have involved the use of educational materials, primarily videotapes, to encourage patients to actively participate in their healthcare. Although initial assessments of these approaches have been encouraging, randomized clinical trials (RCTs) are lacking for most SDM interventions. Our study used an RCT design to assess the impact of a standardized video program for patients considering Prostate Specific Antigen (PSA) screening.

Methods: Male patients eligible for PSA testing were recruited from five VA outpatient clinics and randomized to either SDM video or non-video groups. Prior to meeting with their primary care provider, those in the SDM group viewed a PSA video from the Foundation for Shared Medical Decision-Making. The control group received information (verbally and in writing) traditionally used by the participating centers for PSA test candidates. Following the provider meeting, patients in both groups were administered written questionnaires ascertaining their decisions to undergo or decline PSA testing. Consisting largely of previously validated instruments, the surveys also evaluated patients' overall satisfaction with care; knowledge about PSA testing; decision-making and information-seeking preferences; and decisional conflict. Comparisons of categorical variables between the two groups were performed using chi-square analysis, while continuous variables were analyzed using t-tests.

Results: A total of 91 patients were randomized to either SDM (n=43) or control (n=48) groups. While no significant differences between the two groups were noted in age, race, or marital status, the control group reported a significantly higher educational level than the SDM group (p=0.04). Fewer SDM patients chose to undergo testing (59.5%) compared with controls (80.4%) (p=0.099). SDM patients were more satisfied with both the information received (p=0.08) and their levels of input into the testing decision (p=0.07). Furthermore, the SDM group demonstrated significantly greater knowledge about PSA testing compared to the control patients (p=0.0001). Both groups expressed a strong desire for information; but SDM patients expressed significantly greater preferences for active participation in the PSA decision (p=0.0075). Finally, in spite of assuming larger roles in medical decision-making, SDM patients did not report significantly higher levels of anxiety or uncertainty surrounding their decisions.

Conclusions: VA patients want information to help them make decisions about their healthcare. Implementation of a video-based SDM protocol for patients considering PSA screening appears to result in significantly greater knowledge and preferences for active decision-making roles. These findings contradict reports by Ende and others (1989) who found that older, less educated patients prefer less information and participatory roles.

Impact: Our findings have important implications for designing and implementing patient-centered care in VHA. Patients want and need information to help them make decisions about their healthcare. SDM videos offer a means of conveying the results of outcomes research in a way that patients can understand and use to make decisions consistent with their preferences and values.

4. Effectiveness of VA Primary Care Firm Systems: Preliminary Findings

Elizabeth Yano, PhD, Mingming Wang, MPH, Lisa Rubenstein, MD, MSPH. Center for the Study of Healthcare Provider Behavior, Sepulveda, CA.

Objectives: As a healthcare delivery model, firm systems have been associated with improved prevention, continuity and coordination. By 1996, many VA facilities had launched firm "like" primary care delivery models, with little information about the relative effectiveness of the variations being used. We assessed the relative performance of VA firm systems in contrast with non-firms in terms of preventive and chronic disease care and patients' satisfaction with continuity and coordination.

Methods: In 1996, a national VA expert panel operationally defined a VA firm system through a modified Delphi process that examined the relative importance and contribution to the suggested effects of firms of each of 30 proposed features. Survey items based on these features were incorporated into a 50-item organizational survey, pilot tested and fielded in June 1996 among all VAMCs nationwide. A VAMC was classified as having a firm system if they had 1+ interdisciplinary primary care teams with patients indefinitely assigned to a primary care provider who was responsible for care from clinic-to-ward. We used these survey results (100% response rate) to evaluate the performance associated with VA firm systems using baseline chart-based data from the VHA External Peer Review Program and 1996 VHA National Customer Feedback Center patient satisfaction data. We compared performance associated with firms vs. non-firms and among alternate firm system specifications using the Kruskal-Wallis test.

Results: Overall, 35 (21.9%) VAMCs had firm systems. Compared to non-firms, VA firms served fewer patients (p<.05), but achieved higher proportions of patients who reported having a primary care provider (76.4% vs. 71.3%, p<.05). Preventive practices were higher in firms vs. non-firms (Prevention Index .79 vs. .74, p<.05), with specific benefits in alcohol counseling and colon-cancer screening (p<.05). The Chronic Disease Index scores were also higher among firms (.87 vs. .82, p<.05), with higher performance of sensation exams and foot pulse checks among diabetics, and exercise counseling among hypertensives and obese patients (each p<.05). On average, patients reported slightly fewer problems with continuity (.24+/-.12 vs. .28+/-.10, p=.08). VA firms were more likely to have specialty referral and notification policies (p<.01). The subset of firms with randomized patients and providers and the larger set of firms without inpatient-outpatient continuity had few performance benefits in contrast.

Conclusions: VA healthcare facilities adopting firm systems as their primary care delivery model have higher proportions of patients who report having a primary care provider, provide more preventive care, and higher quality of care for selected chronic conditions. Patients were only marginally more satisfied with their continuity of care. More research is needed to understand the key ingredients of effective delivery models to support the continued growth and development of VA primary care delivery systems, including the adoption of managed care practices, especially as they relate to interdisciplinary teams of providers.

Impact: This work will support the planning and design of VA primary care delivery systems that are associated with higher facility performance.

HSR&D Funded: MPC 97-012

5. Do Patients with Mental Disorders "Unnecessarily" Use More Medical Services? Policy Implications for Mental Health Capitation

CS Hankin, PhD, A Spiro III,PhD, and D Miller. Bedford VA Medical Center, Bedford, MA. D Mansell,MD, MPH. Assistant Professor, Birmingham, AL LE Kazis, ScD, Bedford VA Medical Center, Bedford, MA.

Objectives: It is commonly believed that patients with mental disorders "unnecessarily" use high rates of medical services; the objective of the present study was to explore this assumption. We examined patterns of medical services use among VA ambulatory care patients who screened positive for depressive, alcohol-related, or posttraumatic stress (PTSD) disorders. We hypothesized that even with adjustment for age and medical disease comorbidity, patients who screened positive for targeted mental disorders would have higher rates of medical services use that those who did not screen positive.

Methods: Baseline data were obtained from the Veterans Health Study, a longitudinal investigation of the health of 2,425 Boston-area, male VA ambulatory care patients. Screening measures were CES-D for depression, CAGE for alcohol-related disorder, and PCL-C for PTSD. Prior medical services use (number of inpatient stays in the prior 12 months, and emergency room visits, outpatient visits, or telephone contact with medical personnel in the prior 3 months) was assessed by self-report. The Disease Burden Index (DBI; Kazis et. al., 1998) was used to adjust for medical comorbidity. We compared unadjusted means between groups using t-tests. We then used general linear modeling to compare means, adjusting for age and DBI.

Results: In unadjusted analyses, patients screening positive for depression reported significantly more inpatient stays (1.86 vs. 1.53), outpatient visits (4.80 vs. 3.15), and telephone contacts (2.53 vs. 1.83); following adjustment for age and medical comorbidity, only the significant difference in number of inpatient stays (1.78 vs. 1.58) remained. Prior to adjustment, patients screening positive for alcohol-related disorder reported significantly more inpatient stays (2.16 vs. 1.57), fewer emergency room visits (1.20 vs. 2.12), outpatient visits (3.36 vs. 3.78), and telephone contacts (2.05 vs. 2.15); however, with adjustment, differences in number of inpatient stays (2.02 vs. 1.58) and outpatient visits (2.56 vs. 3.85) remained significant, but differences in number of emergency room visits and telephone contacts no longer met statistical significance. Prior to adjustment, patients screening positive for PTSD reported significantly more inpatient stays (1.82 vs. 1.59), emergency room visits (2.47 vs. 1.66), outpatient visits (4.76 vs. 3.46), and telephone contact (2.88 vs.1.88); following adjustment, differences in medical services use were no longer significant.

Conclusions: Although unadjusted analyses of medical services use revealed clear effects of the screening presence of mental disorders on most outcomes, after adjusting for age and medical comorbidity, many of these effects no longer met statistical significance.

Impact: Our findings have particular relevance for private sector managed care organizations, where restrictions on mental health benefits ("capitation") serve to reduce adverse selection of patient with mental disorders who are assumed to be poor risk because they "unnecessarily" use high rates of medical services. Our findings do not support the notion of such a discrete or direct relationship between mental disorders and medical services use. Results suggest that capitation strategies which are based upon the presumed relationship between mental disorders and medical services use should reconsider the important contributions of age, comorbid medical disorders, and specific mental disorder diagnoses.

HSR&D Funded: SDR 91-006

6. A Comparison of VA to Public Sector Mental Health Patients: the Connecticut Outcomes Study

Rani Hoff, PhD, Robert Rosenheck, MD, M Sernyak, J Steiner, S Atkins. VA Connecticut Healthcare System, West Haven, CT.

Objectives: This paper presents results from a study comparing mental health service delivery to seriously mentally ill patients at three institutions: a VA hospital and two local community mental health centers operated by the State Mental Health Agency (SMHA). The objective was to compare mental health care delivered in VA to those services delivered to a socio-demographically similar population in community mental health centers.

Methods: A random sample of 600 patients with serious mental illness were taken from the three institutions (200 at each) and interviewed about their clinical status, service use, satisfaction with services, and needs and barriers to care.

Results: VA patients were older, less likely to be non-white, had higher incomes both from entitlements and other sources, had fewer problems with housing, and were more satisfied with their housing. They also received significantly more medical care, particularly outpatient medical care, than did SMHA patients, even after controlling for age and medical conditions. There were no differences in the severity of mental health symptoms or use of inpatient mental health care across the three sites. However, VA was less community oriented in its outpatient mental health care: VA patients were less likely to have received case management and rehabilitation services, were more likely to be receiving individual therapy and medication management from a psychiatrist, and were less likely to be taking atypical antipsychotics. These differences persisted after controlling for severity of symptoms, age, race, marital status, income, and education.

Conclusions: We conclude that the integrated medical system in VA affords veterans better access to needed medical services; that the VA in Connecticut has successfully moved away from a focus on inpatient mental health care; but that VA has not made a complete transition to community oriented mental health care.

Impact: The impact of this research highlights the advantages of an integrated medical system in ensuring veterans' access to all types of health care. However, it also indicates that mental health treatment in VA has not been completely translated to a community-oriented model.

HSR&D Funded: PPR 94-002

7. Comparing Quality of Mental Health Care in Public Sector and Privately Insured Populations: First Efforts and Methodological Challenges

Douglas Leslie, PhD and Robert Roseheck, MD. VA Connecticut Healthcare System, West Haven, CT.

Objectives: Comparing quality of care between large health care systems is methodologically difficult, but is an important challenge to health care system management. This study demonstrates methods for measuring quality of mental health care and compares a sample of VA and privately insured patients using these measures.

Methods: Using discharge abstracts, we identified individuals receiving inpatient mental health care in VA during the first six months of each fiscal year 1993 to 1995. A similar cohort of privately insured individuals was identified using MEDSTAT's MarketScan database. These individuals were tracked for six months following discharge and length of stay, readmission rates, and access to outpatient services were calculated. Means of these variables, adjusted for patient characteristics, were compared over time and between the two populations.

Results: The private sector outperformed VA with respect to most of the quality measures, although these differences were modest in magnitude and are likely explained by the fact that VA patients are generally more severely ill and far more socially disadvantaged. However, readmission rates increased considerably over time in the private sector, whereas they declined among VA patients. The outpatient measures improved in both systems, with VA improving more on the number of outpatient visits after discharge and the private sector improving more with respect to the number of days to the first outpatient visit after discharge. VA outperformed the private sector with respect to the continuity of care measure in each year. Quality measures varied by diagnosis, with VA performing better relative to the private sector in treating patients diagnosed with substance abuse and mental health disorders not elsewhere classified, but performing relatively worse in treating patients belonging to the depression diagnostic groups. Unfortunately, variables describing income, disability and homelessness were not available to adjust for major differences between patients treated in the two systems.

Conclusions: Although the private sector outperformed VA to a modest degree with respect to these quality measures (with the exception of continuity of care), VA improved markedly over time compared to the private sector, especially with respect to the inpatient quality measures, and treats a more troubled population for which adjustment was not possible.As these systems continue to adopt strategies to reduce the costs of care and as government systems are increasingly compared to their private sector counterparts, methods for comparing and evaluating the quality of care delivered become increasingly important, although methodological challenges, as illustrated here, are substantial.

Statements: This study provides a benchmark for quality of mental health care in VA as efforts are made to reduce costs. Although similarities in these quality measures between VA and the private sector are impressive (especially given the fact that VA treats a more severely ill population), this study shows that there is room for improvement.

8. Comparing Reimbursement Models for VA Mental Health Services

Douglas Leslie, PhD, Robert Rosenheck, MD, Rani Hoff, WD White. VA Connecticut Healthcare System, West Haven, CT.

Objectives: VA funding mechanisms have historically relied on previous utilization as a basis for distributing funds, and have been criticized as rewarding inefficient provision of care. In response to such criticisms, there is a desire to base these funding mechanisms entirely on patient characteristics. This study explores the impact of using various reimbursement models based on two patient classification schemes - a functional assessment measure (the GAF) and clinical diagnosis - to distribute funds for VA mental health care across VISNs.

Methods: We identify a cross-sectional sample of veterans treated in specialty mental health clinics during a two-week period in fiscal year (FY) 1991. Data from the Patient Treatment File, Outpatient Care File, and the Cost Distribution Report were combined to calculate total utilization and costs for this sample during FY 1991. We then simulate hypothetical reimbursement amounts for these patients based on five different reimbursement models: 1) reimbursement based on average total cost per capita (average cost), 2) reimbursement based on average total cost by GAF score (GAF-based), 3) reimbursement based on average total cost by diagnosis (diagnosis-based), 4) outpatient care reimbursed based on average overall outpatient costs and inpatient care reimbursed based on average inpatient costs by GAF score (GAF-based inpatient), and 5) outpatient care reimbursed based on average overall outpatient costs and inpatient care reimbursed based on average inpatient costs by diagnosis (diagnosis-based inpatient). Total simulated reimbursement by VISN for each of these models was then compared to actual resource utilization.

Results: The distribution of funds nationally across VISNs changes substantially as a result of our reimbursement models compared to actual expenditures. The percentage of total VA expenditures redistributed across VISNs as a result of our models ranges from 6.86% for the diagnosis-based reimbursement model to 8.29% for the simple average cost reimbursement model. However, using functional or diagnostic measures resulted in only small changes from simple average cost capitation. The effects on individual VISNs were substantial and consistent across reimbursement models, with some VISNs experiencing an increase in funding of over 30% and others experiencing a decrease of almost 22% in some simulations.

Conclusions: Reimbursement mechanisms based on functional measures could have a substantial impact on funding patterns compared to current regimes, although they make only minor changes compared to a simple average cost capitation rate. Ideally, one would like to base the distribution of funds on the inherent costs of treating patients in the VA system. Our use of GAF scores and diagnoses is a step in the right direction, but these measures are probably imperfect bases for classification and predicting costs because they are based on clinician judgement and are vulnerable to rater bias.

Impact: These preliminary analyses demonstrate the application of simple, readily available clinical classification schemes to reimbursing VA mental health care. Further analyses are underway to elucidate the strengths and weaknesses of this approach.

9. Impact of Primary Care Satellite Clinics on Access to General Health Care Services and Mental Health Services

Robert Rosenheck, MD. VA Connecticut Healthcare System, West Haven, CT.

Objectives: This study sought to determine whether the establishment of community-based primary care clinics (CBOCs) facilitate access to general health care and/or mental health care services, in both the general population and among people with disabling mental illness.

Methods: From the last quarter of FY 1995 through the third quarter of FY 1997, the Department of Veterans Affairs established thirty-four new community-based primary care clinics in underserved areas. Data were obtained from the 1990 Census on the number of veterans residing in each US county. Data were also obtained from VA's computerized workload data bases (the Patient Treatment File and the Outpatient Care File) on the number of veterans residing in each US County who used VA health and mental health services In FY 1995, before the clinics were established and FY 1997 and used to determine the proportion of veterans in each county who used VA health and mental health services. Analysis of Covariance was used to compare changes from FY 1995 - FY 1997 in use of VA services in counties in which new primary care clinics were located and in other US counties, adjusting for potentially confounding factors such age distribution, race and gender composition, and income distribution.

Results: Counties in which new clinics were established in late 1995-6 showed an increase in the proportion of veterans who used general VA health care services that was almost twice as large as that observed in comparison counties (2.3% vs 1.3%; F=4.94; df=1,3117; p=.03). However, introduction of these clinics was not associated with greater use of specialty VA mental health services in the general veteran population; or of either general health care services or mental health services among veterans who received VA compensation for psychiatric disorders. Interaction analysis showed that CBOCs had their greatest impact on VA service use in counties with larger proportions of low income veterans (beta = 0.006; F=2.11; df=1,3019; p=.03) and had less of an impact in counties with a high proportion of hispanics (beta=-.35; F=2.20; df=1,3019; p=.02).

Conclusions: Community-base primary care clinics successfully improve access to general health care services but do not improve access to specialty mental health care for either the general population or for people with serious mental illness.

Impact: In part as a result of this study, the Under Secretary's Special Committee on Treatment of Seriously Mentally Ill Veterans recommended that specialty mental health staff be included in planning of future CBOCs and the Undersecretary has approved the recommendation.

HSR&D Funded: PPR 94-002

10. Corticosteroid Utilization and Outcomes in HIV Associated Pneumocystis Carinii Pneumonia: Three-fold Higher Mortality among Severely Ill Patients when Corticosteroids given by CDC Guidelines

Charles Bennett, MD, PhD and TC,Ilraith. Chicago VA Hospital, Chicago, IL.

Objectives: Experience with the management of Pneumocystis carinii pneumonia (PCP) exploded with the onset of the AIDS epidemic. Anecdotal reports of improved outcome when steroids were used as adjuncts to appropriate anti-microbial therapy led to controlled trials demonstrating their efficacy.[Bozette S, NEJM] The CDC created guidelines supporting adjunctive therapy with corticosteroids. PCP management during 1995 to 1997 was evaluated for variations in guideline adherence and outcomes.

Methods: Chart reviews from 7 states, 74 hospitals (66 non-VA and 8 VA), and 1,660 empirically diagnosed or confirmed PCP cases.

Results: 735 (44.2%) met CDC guidelines for adjunctive steroids (Aa oxygen gradient > 35 mm Hg or p02 < 70 mm Hg) and 606 (82.4%) received steroids as directed by the guidelines (w/in 3 days of anti-PCP medications). Higher rates of appropriate steroid use were associated with African-American race/ethnicity (84%) versus white (81%) or Hispanics (73%) (p=0.02), younger age (p=0.002), or receiving care in Chicago or Seattle (90%) vs NY, Miami, or LA (71%) (p=0.001). Among severely ill patients with Aa oxygen gradient > 53 mm Hg, 73% were confirmed PCP cases and 82% received corticosteroids per the CDC guidelines. Among these patients, mortality rates were three-fold higher for those who DID receive steroids (18% vs 6%, p=0.02). Similar findings were noted for severely ill persons with confirmed PCP (17% vs 6%). In addition, receiving PCP prophylaxis was associated with higher mortality rates (30% vs 16%, p=.001).

Conclusions: Adherence to CDC guidelines for adjunctive corticosteroid use varied according to city and patient sociodemographics. More importantly, improved outcomes seen in randomized controlled trials were not realized in practice. Among severely ill PCP patients, mortality was three-fold higher when corticosteroids were given according to CDC guidelines. Our findings suggest that the utility of adjunctive corticosteroids in severe PCP needs to be revisited.

Impact: There was a three-fold higher mortality among severely ill patients with associated Pneumocystis carinii pneumonia when corticosteroids were given by CDC guidelines.

11. Use of Centralized VA Data Registry to Assess Quality of HIV Care

Samuel Bozzette, MD, PhD and the HIV-QUERI Executive Committee. Center for the Study of Healthcare Provider Behavior, San Diego, CA.

Objectives: To demonstrate the feasibility of extracting Quality of Care data from the comprehensive longitudinal VA Immunology (HIV) Case Registry (ICR) by assessing the use of newer "highly active" antiretroviral therapies among the HIV-infected under VHA care.

Methods: The HIV-QUERI Coordinating Center was provided with copies of the ICR. We identified unique patients and constructed ratios of the number of patients and of total outpatient visits and hospital discharges, and prescriptions for protease inhibitors or non-nucleoside reverse transcriptase inhibitors (PI-NNRTI). We compared these values with national data on the population of adults under care from the HIV Cost and Service Utilization Study (HCSUS).

Results: Approximately 11,000 unique HIV-infected patients were seen at VA facilities each quarter from the 1st quarter of 1996 (1Q96), when PI-NNRTIs were licensed, to the 4th quarter of 1997 (4Q97). Outpatient visits/100 patients fluctuated from 769 in 1Q96 to 715 in 4Q96 to 851 in 4Q97. However, discharges/100 patients declined monotonically from 30 in 1Q96 to 24 in 4Q96 to 18 in 4Q97. The patterns of use accompanied the rapid adoption of PI-NNRTI therapy in the VA as the percentage of unique patients having at least one prescription written for a PI-NNRTI reached 62% by 4Q96 and 71% by 4Q97. The former compares favorably with estimates that 52 to 61% of all HIV-infected adults under care in the US received the newer drugs in 12/96.

Conclusions: Newer antiretroviral therapies were adopted by VHA providers and patients at least as quickly as by the general population. Increasing use of these agents was accompanied by a dramatic decline in inpatient but not outpatient care.

Impact: Initial comparisons suggest that access of VHA patients to newer HIV therapies is similar to that of other American adults, and that use of these therapies is associated with a reduction in inpatient stays. The VA ICR database contains important information on care for HIV. Improving the validity and accessibility of this database is a high priority for the HIV-QUERI.

HSR&D Funded: HIV 98-000

12. The Prevalence of Hepatitis C in a Sample of Severely Mentally Ill Veterans

Andrew Muir, MD and M Butterfield,. Duke University Medical Center, Durham, NC. KG Meador, Hayden Bosworth, PhD. Durham VA Medical Center, Durham, NC. K Stechuchak, and R Frothingham.

Objectives: There is a pressing need to study Hepatitis C prevalence and risks in veterans including those with severe mental illness. The goal of this study is to establish a prevalence estimate of Hepatitis C in severely mentally ill veterans.

Methods: From March 1 1998- October 15, 1998 consecutive patients admitted to the Durham VAMC inpatient psychiatric unit with a severe mental illness (SMI) diagnosis were serotested for Hepatitis C. SMI diagnoses were defined as meeting Diagnostic and Statistical Manuel of Mental Disorders fourth edition, (DSM-IV) criteria for schizophrenia, schizoaffective disorder, bipolar disorder, or posttraumatic stress disorder (PTSD).

Results: 146 SMI veterans were serotested during the study period. Among these patients, 92.5% were male, 58.9% were African-American. The overall proportion of hepatitis C in this sample of severely mentally ill patients was 17.8% (26 of 146). There was a trend for SMI African-Americans to have significantly higher prevalence rates of Hepatitis C than for SMI Caucasians (24.42% vs. 9.62%). Among those who tested positive for Hepatitis C, 42.3% were diagnosed with schizophrenia, 3.9% with schizoaffective disorder, 7.7% with bipolar disorder, and 46.2% with PTSD.

Conclusion: SMI patients have substantially higher levels of Hepatitis C than what has been reported in community samples. There is a significant trend for SMI African-American patients to have higher Hepatitis C prevalence rates than Caucasian persons with SMI. Positive Hepatitis C was most prevalent among veterans suffering from schizophrenia or PTSD.

Implications: Hepatitis C is a potential epidemic among veterans, including those with severe mental illnesses. Veterans with severe mental illness who are infected with Hepatitis C may increasingly rely on the VA health system for care with substantial cost implications. Further studies are necessary to determine potential Hepatitis C risk factors for SMI persons who are particularly vulnerable to Hepatitis C. Racial differences in Hepatitis C among SMI veterans may exist and warrant further exploration. Increased risk behaviors (intravenous drug and alcohol use) and increased social/contextual risks (community violence poverty, and trauma) have been associated with race/ethnicity and may impact on Hepatitis C and associated risks. Research directed toward understanding Hepatitis C prevalence, transmission, risks, and progression in severely mentally ill veterans is essential.

CSP Funded: EPP 97-022 "HIV Seroprevalence and Risks in Veterans with Severe Mental Illness

13. Management of Hepatitis C at the VA Puget Sound Health Care System

Therese Dawson, BMED. VA Puget Sound Health Care System Seattle, WA.

Objectives: Hepatitis C virus (HCV) infection is emerging as a major health concern in the veteran population. Reports suggest up to 85% of those infected will develop chronic hepatitis and 20% of these will develop cirrhosis. While the prevalence in the VA patient population is estimated to be 10 times that of the general community there appears to be no uniform approach to the management of HCV. Although recent guidelines may help clarify HCV treatment several factors may impede their implementation. The aims of this study were to review the management of patients diagnosed with HCV at the VA Puget Sound Health Care System (VAPSHCS) in 1996 and identify factors influencing this management.

Methods: A retrospective, systematic analysis was made of medical, pathology and pharmacy records of all patients diagnosed with HCV in 1996 at the VAPSHCS. Patients were followed through to May, 1998. Data collected included demographics; diagnostic tests for HCV; history of drug and alcohol abuse; history of HIV, HAV and HBV (testing and status); frequency and results of liver function tests; the presence of concomitant liver disease; HCV notation in discharge summaries; hospital attendances; Gastroenterology referrals; liver biopsies and alpha interferon treatment. Descriptive statistics were performed where appropriate.

Results: One hundred and twenty seven patients were diagnosed with HCV in 1996, 125 males and 2 females (mean age 46 years). Four died during the study, 3 from liver disease. Infection with HCV was detected by ELISA in 119 (94%) and confirmed by PCR in 15 (12%), (RIBA not available). Eight patients (6%) had only PCR results recorded. A history of intravenous and alcohol abuse was recorded in 89 (70%) and 68 (53%), respectively. Thirty-nine patients were tested for HIV (2 positive), 93 for HAV IgM (all negative) and 110 for HBV (70 previous exposure, 3 chronic disease). Liver function tests were performed at HCV diagnosis in 121 patients (95%) of which 63 (52%) were abnormal. Of these, 42/121 (33%) had no subsequent LFTs. Hepatic cirrhosis was recorded in 10 (13%) and hepatocellular carcinoma in 2. Of 149 admissions among 84 patients HCV was recorded in 98 (66%) of their discharge summaries. Twenty-seven patients (21%) have been referred to Gastroenterology and 11 have undergone liver biopsy. Treatment with alpha interferon was commenced in 9 patients.

Conclusions: This review provides an insight into current managementpractices of HCV in our veteran population. Although it is limited by the accuracy and completeness of records and data extraction some conclusions may be drawn. The diagnosis and management of HCV infection at the VAPSHCS lacks uniformity and direction with only 12% of patients receiving confirmatory PCRs. Even once diagnosed, 5% of patients did not have LFTs performed and despite a high incidence of abnormality, a further 33% have not had LFTs repeated. Few patients are referred to Gastroenterology and fewer receive alpha interferon treatment. That HCV has a low profile among health care providers is demonstrated by its lack of inclusion in the discharge summaries of 34% of patients.

Impact: Hepatitis C infection is over represented in the veteran population. Despite its associated morbidity and mortality HCV appears to have a low profile at the VAPSHCS. Although new treatment guidelines have been proposed it is unlikely that these will have significant impact on patient care if an active program for raising the profile of HCV and organizing and centrally implementing them is not established.

14. Hepatitis C Virus Infection and Addiction Disorders in Department of Veterans Affairs Facilities Nationwide

Gary Roselle, MD, and Marta RENDER, MD. VA Medical Center, Cincinnati, OH. SM Kralovic, LH Danko, and LA Simbart.

Objectives: An association exists between Hepatitis C Virus (HCV) infection and addiction disorders (AD), such as illicit injection drug use, inhalation of cocaine, and alcohol ingestion. Alcohol use is of special importance since data suggest an accelerated progression to cirrhosis, and perhaps, hepatocellular carcinoma. This investigation was designed to quantify the extent of comorbidities of documented AD in persons testing positive for HCV antibody (HCVAb).

Methods: The DVA has implemented a national automated electronic surveillance tool (Emerging Pathogens Initiative [EPI]) to extract information from VHA local facility computer systems. The EPI program first identifies persons with a laboratory test positive for HCVAb. Once identified, data are automatically extracted, including demographics such as age, gender, era served, race/ethnicity, and ICD-9-CM coded diagnoses for inpatients. At the Austin Automation Center data are converted to SAS format for analysis by the Infectious Diseases Program Office. Each patient was only counted once, even if the HCVAb test was positive on multiple occasions. AD for inpatients were defined by ICD-9-CM codes and included: Alcohol Only, Cocaine Only, Tobacco Only, Other Drugs Only (including barbiturates, amphetamines, narcotics, etc.), and combinations of these diagnoses. Data were collected from 9/97 - 7/98 (11 months). Statistical analysis used the chi-square test.

Results: Over 11-months, 22,676 persons were identified with a positive test for HCVAb. Mean age was 48.51 (+9.03 SD); 2,021 (8.9%) were noted as homeless; 21,811 (96.5%) were male. 15,981 (70.5%) were outpatients, 6,695 (29.5%) were inpatients; 41% were identified as White, 28.6% Black, and 6.6% Hispanic; 2.6% of inpatients with HCVAb died. 54.2% of inpatients with HCVAb had an ICD-9-CM code for an alcohol-related diagnosis. Any cocaine and any other drug ICD-9-CM diagnoses were seen in 30.5% and 35% of patients who had HCVAb, respectively. 27.9% of persons who were HCVAb positive had no documented AD. HIV infection was seen in 3.7% of inpatients with HCVAb. 81.6% of HCVAb positive persons were from the Vietnam or post-Vietnam era.

Conclusions: 54.2% of inpatients with a positive test for HCVAb had an ICD-9-CM diagnosis related to intemperate use of alcohol, a substance associated with greater severity of HCV-related liver disease. The AD seen in approximately 72% of the patients are often associated with risk behavior for transmission, such as sharing equipment for illicit injection drug use or inhalation of cocaine, and sexual risk behavior. AD in patients with HCV infection will be challenging to provision of the continuum of care; treatment regimen will require complex drug combinations with the need for close follow-up, presenting major obstacles to mitigation of disease.

Impact: The VHA has identified a large population of HCVAb positive persons, creating an inevitable patient care (>22,000 patients to date) and financial (up to 750 million dollars) burden. AD were common, including intemperate alcohol use. Intervention strategies must include VHA data driven targeted screening of risk populations (IL 10-98-013), providing treatment and education for those currently infected, and, most importantly, emphasize prevention of risk behavior that leads to transmission.

HSR&D Funded: DEV 97-032

15. Mortality after Cardiac Bypass Surgery: Prediction from Administrative versus Clinical Data

Jane Geraci, MD, MPH, Howard Gordon, MD, ML Johnson, Nancy Petersen, PhD, L Shroyer, Nelda Wray, MD, MPH. Houston Center for Quality of Care and utilization Studies, Houston, TX.

Objectives: To determine whether the administrative data contained in the VA Patient Treatment File (PTF) can adjust for patient severity and identify hospital mortality outliers identical to severity adjustment and outlier identification using clinical data from a primary data collection, the Continuous Improvement in Cardiac Surgery Program (CICSP).

Methods: We developed logistic regression models to predict operative mortality following cardiac bypass surgery (BYPASS) in 15,288 veterans who underwent bypass from 10/93-3/96. Two models were developed: one from PTF data and one from the CICSP data. Observed-to-expected (O/E) ratios for operative mortality in each of 43 hospitals performing BYPASS were calculated, and hospitals were identified as outliers if the 90% confidence interval for their O/E ratios did not include 1.0. Hospital outlier status was compared for the O/E ratios calculated from each of the 2 logistic models. Because the PTF model and CICSP models did not identify the same hospitals as outliers, clinical variables from the CICSP data set were added, in stepwise fashion (entry criterion pú0.1), to the PTF model to determine whether it could be "enriched" to equal the CICSP model in outlier assignment. Both the PTF and the CICSP models were developed on 2/3 of the study population and validated on the remaining 1/3.

Results: The PTF and CICSP models had comparable predictive power (c statistics=0.767 and 0.760, respectively). The PTF model identified 3 of 6 CICSP high outliers and 1 of 4 CICSP low outliers, plus 2 unique high and 3 unique low outliers. Two additional CICSP variables added to the PTF model resulted in identification of 4 of 6 high and 2 of 4 low outlier hospitals; addition of other CICSP variables increased the PTF modelÆs predictive power (final c statistic=0.811) but did not further improve outlier identification.

Conclusions: PTF data have predictive power for BYPASS operative mortality. Addition of a few clinical variables improved the PTF modelÆs hospital outlier assignment, but differences between the PTF and the CICSP model in this performance remained.

Impact: Administrative data have an ability to predict operative death following BYPASS that is comparable in predictive power to that of clinical data. The comparable predictive power yet unique hospital outlier identification suggests that the PTF model and CICSP model adjust for different things. The addition of a small number of clinical variables not currently available in the PTF improved its ability to detect hospital outliers, as measured against the CICSP data.

HSR&D Funded: 95-005

16. The Houston Approach to Optimal Risk-Adjustment Using Administrative Data

Howard Gordon, MD, Jane Geraci, MD, MPH, ML Johnson, Nancy Petersen, PhD, L Shroyer, and Nelda Wray. Houston Center for Quality of Care and Utilization Studies, Houston, TX.

Objectives: To develop a comprehensive risk adjustment that takes full advantage of the data available in an administrative database.

Methods: We analyzed 15,288 veterans who underwent cardiac bypass surgery (BYPASS) in the Department of Veterans Affairs (VA) between 10/93-3/96, using data from the Patient Treatment File (PTF), the administrative data base on inpatient hospitalizations maintained by the VA. Data included death within 30 days of BYPASS, age, date of surgery (weekend versus other), ancillary procedure performance before or on the day of surgery (coronary angioplasty or intraortic balloon pump (IABP)), and the ICD-9-CM principal and up to 9 comorbid diagnosis codes. Diagnoses identified as possible complications of BYPASS were not used for risk-adjustment. The frequency of post-operative death for principal and comorbid diagnoses was ascertained in a developmental set of FY92-93 BYPASS cases. Principal diagnoses that occurred in 30 or more cases were coded individually. Less frequent principal diagnoses were grouped together into a "rare principal" variable. Comorbid diagnoses were ranked in five groups by risk of death, for codes occurring in at least 30 cases. Less frequent comorbid diagnoses were grouped together into a "rare" group. Patients without any comorbid diagnosis codes were placed into another group. Stepwise logistic regression was used to choose important independent predictors of death within 30 day of BYPASS. In addition, we explored whether a count of comorbid conditions had independent predictive power, and whether a count within each of the comorbidity groups was predictive. The model was developed on 2/3 of the study sample and validated on the remaining 1/3. Data are presented from the full study sample.

Results: Eight independent predictors of postoperative death were identified: age, weekend surgery, angioplasty on the day of surgery, IABP before or on the day of surgery, and 4 variables representing principal or comorbid diagnoses. Two principal diagnosis codes were protective against operative death: angina pectoris (413) and "other forms of chronic ischemic heart disease" (414). A count of the comorbidities within the group having the lowest mortality rate in the developmental set also was protective. Having any comorbidity from the rare group increased the risk of postoperative death. The model c statistic=0.767, Hosmer-Lemeshow goodness-of-fit statistic=4.4 (p=0.82).

Conclusions: Administrative data have moderate ability to predict operative death following BYPASS. Even in a homogenous group of patients undergoing the same surgical procedure the principal medical diagnosis influenced the risk of death, and should be handled separately from comorbid conditions. Some comorbid conditions were more influential than others in predicting death, illustrating that a unit-weighting of them does not accurately reflect their risk.

Impact: Administrative data have moderate ability to predict operative death following BYPASS. Even in a homogenous group of patients undergoing the same surgical procedure the principal medical diagnosis influenced the risk of death, and should be handled separately from comorbid conditions. Some comorbid conditions were more influential than others in predicting death, illustrating that a unit-weighting of them does not accurately reflect their risk.

HSR&D Funded: 95-005

 

17. A Markov Model of Severity of Illness States and Hospital Mortality

ML Johnson, W Chan, DH Kuykendall, and Carol Ashton, MD, MPH. Houston Center for Quality of Care and Utilization Studies, Houston, TX.

Objectives: To model the course of hospitalization from admission to discharge or death using a Markov model of illness severity states derived from laboratory data.

Methods: Laboratory data was collected using the Health Summary component of VISTA for 476 consecutive patients admitted with non-psychiatric principal diagnoses to the general medicine section of the Houston VAMC. Laboratory test results were scored to create APACHE-L severity of illness measures for each day of the hospital stay that laboratory tests were conducted. Patients were classified into Low, Medium, or High severity states based on the APACHE-L scores. A Markov chain is proposed to model the transition of patients between severity states over the course of the hospital stay, until reaching states of discharge or hospital death, defined as death in the hospital or within 30 days of discharge. A total of 12 possible transitions can occur from day to day: from Low to Medium (LM), Low to High (LH), Low to Discharge (Ldisch), or Low to Dead (Ldead); and similarly four each from Medium and High. A split sample technique was employed to validate predictions of transition rates between severity states, and from severity states to discharge or death.

Results: In the development sample, 44.5% of patients were admitted in severity state Low (106/238), 46.2% in Medium (110/238) and 9.2% in High (22/238). The overall hospital mortality rate was 9.2% (22/238), with a 3.8% mortality rate occurring in patients admitted in Low state (4/106), 9.1% in Medium (10/110) and 36.4% in High (8/22). Median waiting times were 4 days in a Low state, 2 days in Medium and 1 day in High. Example transition rates were: Ldisch 8.7%, meaning patients in a Low state had a 8.7% probability of discharge the next day; Hdead 6.25%, meaning patients who ever reach a High severity state faced a 6.25% chance of dying before the next day. Rates were applied to the validation sample and accurate predictions were found, including: 149.55 expected discharges from Low state with 149 observed; 9.6 expected Hdead transitions, 6 observed; and 5.8 Ldead transitions, 6 observed. Stationary transition probabilities obtained from the limiting probability distribution were 6.1% deaths from Low state, 9.0% Medium and 21.6% High for an entire course of hospitalization.

Conclusions: A Markov model can be constructed from laboratory data to accurately predict transitions between severity of illness states and from severity states to discharge or death. Waiting times indicate relatively quick departure from High and Medium severity states, but relatively long stays in a Low severity state before being discharged, with risk of becoming more ill or even dying.

Impact: Further research is needed to explore methods to use results of Markov modeling as quality of care indicators. In addition to hospital mortality rates, performance could be monitored on rates of improvement or worsening during the course of hospitalization. To improve quality of patient care, a computerized system could track severity states of patients daily to provide a synthesis of laboratory data and risk of mortality to physicians.

 

18. Hospital Profiles of Mortality from Cardiac Bypass Surgery: Effect of Definition of Outcome based on Administrative versus Clinical Data

ML Johnson, JM Geraci, NP Wray, HS Gordon, MJ Petersen, AL Shroyer. Houston Center for Quality of Care and Utilization Studies, Houston, TX.

Objectives: To determine whether using a definition of post-operative mortality based on administrative data from the Patient Treatment File (PTF) affects identification of hospital mortality outliers derived from a model of post-operative mortality based on clinical data from a primary data collection the Continuous Improvement in Cardiac Surgery Program (CICSP).

Methods: A sample of 15,288 patients from the CICSP data collection who underwent cardiac bypass surgery from 10/93 to 3/96 were studied. The CICSP defined post-operative mortality as any death occurring within 30 days of the operation, or any post-surgical death attributable to surgical complication by medical peer review. Post-operative death was defined using administrative data as any death occurring within 30 days of surgery. Agreement of the outcome variables defined by administrative data versus clinical data was assessed. A logistic regression model was constructed to predict the dependent variable, operative mortality, as defined by CICSP, using the CICSP clinical data as independent variables in a backward stepwise selection (Model 1). Observed-to-expected (O/E) ratios for operative mortality in each of 43 hospitals performing bypass were calculated, and hospitals were identified as outliers if the 90% confidence interval for their O/E ratios did not include 1.0. A second logistic model was constructed using the same independent variables from Model 1, but substituting the dependent variable with post-operative mortality as defined by the PTF to determine the unique effect of the definition of outcome on hospital profiles (Model 2).= Hospital outlier status was compared for the O/E ratios calculated from each of the 2 logistic models.

Results: CICSP classified 557 patients as post-operative deaths, and the PTF classified 498 as post-operative deaths. Sensitivity of the PTF definition to the CICSP was 89.4% and specificity was 100%. Model 1 identified 6 hospitals as high outliers and 4 hospitals as low outliers. Model 2 identified 5 high outliers, 3 of which were original outliers, and 3 low outliers, 2 of which were outliers originally.

Conclusions: Agreement of classifications of post-operative death was very high between administrative data and clinical data. However, using the definition of death from administrative data resulted in 10.6% fewer patients classified as a post-operative mortality, due to the inability of the administrative data to capture post-30 day deaths attributed to the surgery by medical review. This discrepancy in the definition of death further resulted in different hospitals being identified as outliers than originally derived from clinical data alone.

Impact: Further research to examine the sensitivity of hospital profiles to changes in outcome definition is needed to determine best use of both administrative and clinical data. The PTF is a highly accurate source of identifying post-operative death from cardiac bypass surgery overall; however, the administrative database does not contain the clinical information to identify which post-30 day deaths are due to surgical complications. Hospital profiles developed from clinical or administrative models may differ because of differences in the definition of outcome even when the independent variables are identical.

HSR&D Funded: IIR 95-005

19. Accuracy of Computer Identified Diagnoses in a VA General Medicine Clinic

Herbert Szeto, MD, MPH and Mary Goldstein, MD. VA Palo Alto, Palo Alto, CA.

Objectives: Many existing and proposed critiques of medical care rely on DHCP diagnoses. Whereas the accuracy of VA inpatient diagnoses in VISTA/DHCP versus charts have been well studied, little is known about the accuracy of outpatient diagnoses. This study sought to examine the accuracy of diagnoses for hypertension-relevant disorders recorded in DHCP when compared to the outpatient medical record.

Methods: We undertook a cross-sectional chart review to assess the accuracy of common medical diagnoses that may affect the choice of anti-hypertensive therapy. Eight clinical conditions, asthma/COPD , atrial fibrillation, BPH, congestive heart failure, coronary artery disease, diabetes mellitus, gastroesphogeal reflux disease (GERD), hyperlipidemia, and hypertension were assessed in the general medical clinic at VA Palo Alto. Charts of patients scheduled to one of the half-day clinics of 16 residents, 5 nurse practitioners (NPs) and 5 attending physicians (MDs) were reviewed for the week of May 18-22, 1998. A half-day clinic schedule was chosen by convenience for MDs and NPs who had more than one general medicine clinic that week. Clinic charts of 137 of the 148 scheduled established patients were available for review. A diagnosis was considered to be present if it was listed either in the past medical history or as part of the problem list for any past note in the clinic record. A list of diagnoses for each patient was then obtained through DHCP and compared to diagnoses listed in the chart.

Results: The prevalence of the conditions varied from 5.1% for CHF to 51.1% for hypertension. Using the outpatient record as the gold standard, the sensitivity/specificity of DHCP for the conditions are as follows: asthma/COPD (.43/.96), atrial fibrillation (.89/.97), BPH (.3/.95), congestive heart failure (.57/.97), coronary artery disease (.57/.98), diabetes mellitus (.77/.95), GERD (.58/.97), hyperlipidemia (.73/.88), and hypertension (.74/.79). The specificity of DHCP was generally greater than .95, but was as low as .79 for hypertension. The positive predictive value for a diagnosis listed in DHCP varied from .50 for BPH to .89 for CAD. One of the limitations of this study is that patients were chosen through scheduled appointments with specific providers. As is typical of university affiliated VA clinics, our clinics are staffed by resident and staff physicians. Since resident physicians have clinic scheduled only once a week, the sample was disproportionately shifted toward patients cared for by residents. Moreover, the patient population may be biased toward patients with a greater number of medical problems, who seek medical attention more frequently. Coding of diagnoses for these patients may be less complete since providers are less likely to list secondary diagnoses related to any one visit.

Conclusions: This pilot study suggests that significant discrepancies may exist between clinic records and the DHCP system. Diagnoses were often omitted from DHCP, and some diagnoses present in DHCP were not present in the clinic record.

Impact: As we move into an era where electronic clinical databases may be used to assess quality, risk adjust, or as a basis for automated treatment recommendations, careful attention must be paid to the accuracy of such data.

 

20. Prostate Cancer Quality of Life and Outcomes Research among Patients with Low Socioeconomic Status: An Overview of the VA Cancer of the Prostate Outcomes Study (VA CaPOS)

Simon Kim, MPH. Chicago, VA Hospital. SJ Knight, E Moran, CN Robertson, and JE Smith. Charles Bennett, MD, PhD. Chicago VA Hospital, Chicago, IL.

Objectives: Outcomes assessment for prostate cancer are important, because of debates over the benefits and costs of alternate treatments and outcomes. Because of a lack of evidence of survival benefits with specific therapies, quality of life (QOL) evaluations have taken on increased importance. QOL is rarely assessed among racial/ethnic minorities and men of lower socioeconomic status, who make up a disproportionately large part of the prostate cancer burden. We have initiated the first multi-center QOL outcomes study of lower socioeconomic status men, the VA Cancer of the Prostate Outcomes Study (VA CaPOS).

Methods: VA CaPOS QOL information is collected from prostate cancer patients, spouses, and physicians at six VA medical centers. Because of low rates of literacy, interviewers assess QOL, involvement in care, and the relative importance of likely outcomes following alternative treatments. Spouses provide proxy ratings of patient QOL. Physicians provide information on patients' performance status and the patients' perceived preferences for alternate outcomes. Medical records and electronic databases are reviewed for sociodemographic characteristics and relevant clinical characteristics.

Results: Currently, 601 men with prostate cancer are included in the VA CaPOS, over half of whom are African American. The mean time since diagnosis was 1.4 month for newly diagnosed patients and over 4 years for the rest. QOL responses were most favorable for newly diagnosed, intermediate for stable metastatic disease, and poorest for progressive metastatic disease patients, most of whom had been followed for several years. Spouse emotional well-being assessments were significantly worse than those of individual patients. While patients were not able to provide reliable estimates of their own preferences for future QOL states, they were able to respond reliably to questions phrased as a comparison of the preferences of two hypothetical patients. While African American prostate cancer patients were more likely to have advanced stage disease at the time of diagnosis, after adjustment for differences in health literacy, race was no longer a significant predictor of having advanced prostate cancer.

Conclusions: The VA CaPOS provides useful information on health status, QOL, and low literacy for VA prostate cancer patients. Our results indicate that valid and reliable assessments in low literacy populations are feasible, but that long-term evaluations are needed to detect clinically meaningful information on QOL as the disease progresses. Alternative sources of QOL information, such as spouses, provided results that had poor concordance for emotional and social functioning, but were generally valid for other dimensions of health. The reliability of patient ratings of future QOL states was increased when questions were based on two hypothetical friends rather than consideration by the patients themselves of two potential, but different, future health states. Observational database efforts are potential sources of important information for lower socioeconomic status patients who are faced with difficult therapeutic decisions, limited financial resources, and concerns over both quantity and quality of life outcomes with alternative therapies.

Impact: VA CaPOS provides useful information on health status, QOL, and low literacy for VA prostate cancer patients. It also provides useful information about spouse proxy ratings of patient QOL.

21. Prevalence of Lower Urinary Tract Symptoms and Associated Resource Utilization among VA Primary Care Patients

Elizabeth Yano, PhD, MSPH. VA Greater Los Angeles Healthcare System, Sepulveda, CA. AB Lanto. Timothy Wilt, MD, MPH. VA Medical Center, Minneapolis, MN. Lisa Rubenstein, MD MSPH. VA Greater Los Angeles Healthcare System, Sepulveda, CA.

Objectives: In 1997, nearly 750,000 male veterans had outpatient diagnoses of benign and malignant prostate disease, yet little is known about their presenting symptoms in primary care or associated resource utilization, information that would be useful in the design of programs to systematically screen and treat them. We assessed the prevalence of lower urinary tract symptoms consistent with the presentation of prostate disease among VA primary care patients and assessed their VA healthcare utilization.

Methods: These data were drawn from a longitudinal cohort of randomly sampled male veterans in no acute distress who were visiting the Primary Ambulatory Care and Education (PACE) Center from March-June 1993. Using the Survey of Health and Medical Care designed for the evaluation of PACE, a primary care firm system, we conducted a telephone survey of 1,849 veterans with 3+ primary care visits regarding their health status and symptoms. Lower urinary symptoms (e.g., nocturia) were queried using items developed by a national panel of academic urologists. Cutpoints were selected to identify the most clinically meaningful symptom burden. Survey data were linked with VA administrative data to evaluate general medicine and subspecialty outpatient visits (particularly urology), and admission rates during the following year. We used logistic regression to evaluate the predictors of symptom burden among primary care patients.

Results: For specific symptoms, 24.4% of men reported sometimes-to-frequently having urinary urgency (11.2% frequently), 12.1% reported sometimes-to-often having problems urinating in the previous month (4.0% often), and 24.1% reported urinating 1+ times/hour (4.4% >2 times/hour). Nearly half of those surveyed (47.5%) reported that they urinated 2+ times/night (22.2% with 3+ trips), while over half (56.2%)reported moderate-to-slow streams (11.2% slow and strained). Taking the most severe category for each symptom, we found that 32.9% had 1+ clinically meaningful lower urinary tract symptoms (21.0% with 1, 6.7% with two symptoms). As clinically expected, hypertensives were 53% more likely to report 1+ symptoms (1.53, 95%CI 1.18-1.98), diabetics were 75% more likely (1.75, 95%CI 1.32-2.31), and men reporting shortness-of-breath at rest (1.80, 95%CI 1.28-2.52) or on exertion (2.03, 95%CI 1.49-2.77) were more likely to report 1+ lower urinary tract symptoms (p<.0001). Adjusting for these comorbid conditions, men with 1+ symptoms had significantly more general medicine (p<.01) and urology visits (p<.00001) in the following year compared to men without urinary symptoms. The more symptoms reported, the higher the general medicine (p<.005), subspecialty (p<.0001) and urology (p<.0001) visit rates, as well as medical-and-surgical admission rates (p<.0001).

Conclusions: Male primary care patients have a significant lower urinary tract symptom burden consistent with underlying prostate disease that is associated with significantly higher utilization of VA healthcare resources. Clinical guidelines and pathways that address the optimal role of primary care practitioners and urologists in a coordinated system of care are needed.

Impact: VHA has identified prostate disease as a high impact target condition for QUERI. These analyses are helpful in quantifying the needs of veterans and in assessing how to manage patients in primary and specialty care.

22. Relative Effectiveness of Androgen Suppressive Therapies for Advanced Prostate Cancer

Timothy Wilt, MD, MPH. VA Medical Center, Minneapolis, MN. N Aronson, J Seidenfeld, D Samson, V Hasselblad, and P Albertsen. Charles Bennett, MD, Chicago, IL. PhD Alan Garber, MD. PhD. Center for Health Care Evaluation, Palo Alto, CA.

Objectives: To determine the relative effectiveness of alternative strategies for androgen suppression as treatment of advanced prostate cancer.

Methods: We conducted a systematic review of the evidence from randomized controlled trials Options included monotherapy with surgical or medical orchiectomy (diethlystibesterol, [DES], luteinizing hormone-releasing hormone [LHRH] agonist, or antiandrogens) or combination therapy with additional suppression of adrenal androgens (Combined Androgen Blockade) [CAB]. Three issues were addressed: (1) the relative effectiveness of monotherapy (orchiectomy, DES, LHRH agonists, and antiandrogens); (2) the effectiveness of CAB compared to monotherapy; (3) the effectiveness of immediate androgen suppression for PSA rise compared to androgen suppression deferred until clinical progression. Outcomes included overall, cancer-specific, and progression-free survival; time to treatment failure; adverse effects and quality of life.

Results: There are wide differences in costs of androgen suppression: annual costs were DES = $109; LHRH agonists = $5,000; antiandrogens = $3500; CAB = $8500; surgical orchiectomy per operation = $3000. Survival after treatment with an LHRH agonist is equivalent to survival after orchiectomy or DES (Hazard ratio [HR] = 1.11; 95% CI= 0.89,1.39). The available LHRH agonists are equally effective regarding survival and no LHRH agonist is superior to others when considering adverse effects. Survival may be lower with use of a nonsteroidal antiandrogen (hazard ratio relative to orchiectomy = 1.22; 95% CI = 0.97, 1.54). There is no statistically significant difference in survival at 2 years between patients treated with CAB or monotherapy (HR = 0.97; 95% CI=0.87,1.09). Meta-analysis of the limited data available show a statistically significant difference in survival at 5 years that favors CAB but this is of questionable clinical significance (HR = 0.91; 95% CI = 0.85,0.99). Data suggest that monotherapy has fewer adverse events and results in improved quality life. More men randomized to CAB (10%) withdrew from therapy due to adverse events than men randomized to monotherapy (4%). There is no evidence from randomized trials to compare early androgen suppression initiated upon PSA rise to androgen suppression deferred until clinical progression. There was a significant difference in 5-year overall survival in favor of androgen suppression initiated at the time of radiation compared to radiation alone followed by androgen suppression initiated at clinical progression (HR = 0.63; 95% CI = 0.48, 0.83; NNT at 5 years = 12).

Conclusions: Androgen suppression with orchiectomy or DES provides equivalent survival at lower cost than LHRH agonist, antiandrogens or CAB. Adverse events and quality of life favored monotherapy.

Impact: Androgen suppression for advanced prostate cancer with orchiectomy or DES provides equivalent survival and quality of life compared to LHRH agonists, antiandrogens or CAB. Treatment with orchiectomy or DES would result in considerable cost savings. Despite widespread practice of initiating androgen suppression for rising PSA levels in the absence of clinical signs or symptoms there is no evidence from randomized trials comparing this strategy to androgen suppression deferred until clinical evidence of disease progression. Patients who undergo immediate treatment will have a longer duration of therapy in which they experience the adverse effects and increased costs of androgen suppression.

23. Men's Beliefs about the Benefits of and Professional Recommendations for PSA Screening

Judith Zemencuk MA, and Rodney Hayward MD. Center for Practice Management and Outcomes Research, Ann Arbor, MI. SJ Katz

Objectives: Despite the many uncertainties surrounding screening for prostate cancer, few published studies have examined men's beliefs about the pros and cons of prostate-specific antigen (PSA) testing. This study assesses and describes the beliefs men hold with regard to the benefits of, controversies about, and professional recommendations for screening for prostate cancer by PSA testing.

Methods: Using a self-administered questionnaire developed to measure men's knowledge and understanding regarding PSA testing, we collected data from a sample of men seeking care at a VA medical center general medicine outpatient clinic or at one of two primary care sites of its university affiliate. Of 390 consecutive men, 45 years or older, at the VA medical center site, 270 (69%) consented to participate and returned completed questionnaires. At its university affiliate sites, 119 of the 162 (73%) eligible patients completed questionnaires.

Results: Over 42% of all men reported that they had had a PSA test, while 16% were unsure. Nearly 77%, however, indicated a desire for PSA testing within the next year or two, including 75% of men 70 years and older (for whom the test is not generally recommended even by screening advocates). In general, most men believed regular PSA testing to be highly beneficial. For example, over 80% of all men thought that medical studies have shown that regular PSA testing can reduce a man's chance of dying from prostate cancer by 50% or more. Most men were unaware of the uncertainties surrounding the use of PSA as a screening test. For example, although nearly half of men reported reading or hearing reports about PSA testing, nearly two-thirds were unsure as to whether there was a controversy among medical professionals concerning when and how often a man should get regular PSA testing. Beliefs regarding recommendations for PSA screening for men their age were inconsistent. For example, while 62% of all men thought that the medical profession in general recommends that men their age get regular PSA testing, 46% were unsure as to whether their own physician endorsed a similar recommendation. There were no significant differences in responses at the VA vs. non-VA clinics.

Conclusions: Most men were uncertain as to whether screening for prostate cancer by PSA testing is controversial, while a majority believed that PSA testing is recommended by the medical profession in general. A substantial proportion of men were uncertain as to whether their own physician recommended PSA testing. Still, a large majority believed PSA testing to be substantially beneficial and wanted PSA screening.

Impact: Uncertainties concerning the benefits of screening for prostate cancer using prostate-specific antigen (PSA) have led many to suggest that men be involved in the decision to screen. Indeed, the VA has mandated documentation of PSA counseling. Our study's findings indicate that men may not have sufficient information to make an informed decision regarding screening for prostate cancer by PSA testing and highlight the need to improve men's knowledge and understanding of this screening test.

24. Preventing Urinary Tract Infection using Urinary Catheters Coated with Silver Alloy: A Cost-Effectiveness Analysis

Sanjay Saint, MD, MPH. Center for Practice Management and Outcomes Research, Ann Arbor, MI. DL Veenstra, SD Sullivan, C Chenoweth, and AM Fendrick.

Objectives: Up to 25% of hospitalized patients have a urinary catheter placed at some time during their stay. The overall incidence of nosocomial urinary tract infection (UTI) among patients with an indwelling catheter is about 5% per day. UTIs account for up to 40% of nosocomial infections, with bacteremia complicating nosocomial UTI in about 4% of cases. A recent meta-analysis indicated that silver alloy urinary catheters were efficacious in preventing UTI compared with standard urinary catheters; however, providers must decide whether the efficacy of such catheters is worth the extra cost of approximately $5 per catheter. We performed an analysis to determine the incremental cost and the incremental incidence of catheter-related UTI, bacteremia, and death associated with the use of silver alloy urinary catheters versus standard urinary catheters.

Methods: The decision analytic model, performed from the healthcare payer=92s perspective, was based on patients admitted to acute care hospitals on general medical, surgical and urological services requiring indwelling urethral catheterization between three and six days. Three interventions were compared: 1) universal silver alloy catheter use; 2) silver alloy catheter use only in those at high risk for catheter-related UTI, defined as patients not on systemic antimicrobials; and 3) standard (non-coated) urinary catheter use in all patients. Outcome estimates were derived from several quantitative syntheses of published reports. Cost estimates were based on University of Michigan Health System costs and literature review. Sensitivity analyses were performed and included scenarios in which estimates were set to favor either the universal use of silver catheters or the universal use of standard catheters.

Results: In the base-case analysis, the strategy of universal silver catheter use resulted in an expected cost savings of almost $6 per catheter compared with universal standard catheter use and a 45% relative decrease in the incidence of symptomatic UTI, bacteremia, and death. The strategy of targeted silver catheter use resulted in cost savings of $3.75 per catheter used compared to universal standard catheter use and an expected 20% relative decrease in symptomatic UTI, bacteremia, and death. Sensitivity analyses across the reasonable range of outcome and cost estimates did not dramatically alter these findings.

Conclusions: The results of our analysis indicate that strategies using either universal silver catheters or targeted silver catheters in patients requiring urinary catheterization between three and six days are cost-saving compared to standard catheters and should reduce the incidence of symptomatic UTI, bacteremia, and death. The appropriate use of silver catheters in patients requiring catheterization for less than three days or more than six days remains unclear.

Impact: The universal use of silver alloy-coated urinary catheters in patients requiring catheterization between three and six days should be strongly considered. The base-case analysis suggests that for approximately every 1000 silver-alloy catheters used, an average of $6500 will be saved overall, and 9.7 cases of symptomatic UTI, 1.7 cases of bacteremia and .2 deaths will be avoided.

25. HSR&D Development Center Workshop

Douglas D. Bradham, DrPH. HSR&D Developmental Center, Capital VISN (5), Baltimore, MD.

Purpose: To provide an open discussion (from the trenches) of key issues facing these Centers as they mature into HSR&D infrastructure for their VISNs.

Objective A: To encourage interchange among the current (10) HSR&D Developmental Centers by discussing their approaches to several key issues including:

a) Attracting a critical mass of clinician investigators.

b) Training and mentoring these investigators toward successful LOIs and IIRs.

c) Hiring talented staff in critical areas of:

i) VA Database extraction and programming.

ii) Biostatistics and methodologists.

iii) Health economists.

iv) Others?

d) Acquiring and holding on to space!

e) Maintaining linkage with R&D and VISN-level operational concerns.

f) Gaining VISN-level financial support.

Objective B: To improve the next round of HSR&D Developmental Center applications by discussing the current Centers' approaches to issues including:

i) Critical items in the proposals.

ii) Critical items in the organizational phase.

iii) Critical items in the implementation phase.

iv) Other critical items for success.

Approach: Each topic will be examined by the 10 directors along characteristics of:

a) What works and why?

b) What does not work?

c) Who is helpful and why?

Activities: Each Developmental Center Director will be asked to participate. Modifications in the issues listed above will be generated. Prior to the Annual Meeting, each Director will be asked to lead a posting of ideas for group contributions for a particular topic. The posting of ideas will be recorded and a summary report will be assembled. That report will be made available for the attendees and for HSR&D Headquarters staff for use in encouraging new applicant's success.

Audience: Current and future of applicants for developmental center funding.

Audience Familiarity: Individuals who are considering application for Developmental Center funding should attend.

26. Internet-Based Education for Epidemiology

Michel A. Ibrahim, MD, University of North Carolina at Chapel Hill, Chapel Hill, NC .

Abstract: This workshop is intended to demonstrate the utility of Internet-based courses in basic and continuing education of epidemiology. As an illustration, one module for an outbreak investigation will showcase the technology and demonstrate the interactive and stimulating nature of this mode of learning. A module is a self-contained unit of study that requires advanced readings and consists of an audio tutorial and a review of a case study with a set of questions and answers. An entire course consists of several related modules. You need not to bring anything with you to benefit from this demonstration. However, if you want to have a hands-on experience by actual participation you should bring a laptop with Windows95, Intel Pentium, floppy drive, 16Mb of RAM, 16-bit sound card with headphones, Netscape Navigator version 3.x or 4.x, RealAudio Player and CD-Rom drive. You may download Netscape from http://home.netscape.com/ and RealAudio Player from http://www.real.com - both these programs are free and are needed for the demonstration. No Internet link is necessary during the demonstration. In order to be able to use the technology effectively to complete an actual module or an entire course, the "student" must have the skills and understanding of Internet jargon, Internet navigation, discussion forums, listservs, and other related topics.

Target: The target audience includes The Veterans Administration clinicians, researchers and administrators. The educational offerings would vary in terms of the nature of topics covered as well as the degree of complexity of content from the introductory to the advanced, depending on the particular audience.

27. Using National VA Data in health Services and Epidemiologic Research

Reiber, Gayle, PhD, MPH, and Jennifer MAYFIELD, MD, MPH. VA Puget Sound Health Care System, Seattle, WA. Charles Maynard. Michael Chapko, PhD, VA Puget Sound Health Care System, Seattle, WA.

Objective: To describe and illustrate basic considerations and strategies for use of national VA data in health services and epidemiologic research.

Activities: In this workshop, participants will have an opportunity to follow the steps involved in procuring data from national VA databases. Two clinical examples will provide participants with an overview of the process and specific methods used to obtain the data. The first example is ô what was the prevalence of esophageal cancer in the VA from 1993-1997 and what was the survival experience of these patients? Ö The second example is ô how many lower limb bypass and amputation procedures were performed in VA hospitals between 1992 and 1996? Participants will receive information on administrative and human subjects clearance, database considerations, downloading strategies, sample programs for data extraction, and file linkage and data quality considerations.

Target: Health services researchers with no prior experience using national VA databases.

28. Continuity of Care as a Determinant of Patient Satisfaction. Results from the ACQUIP Study

Marcia Burman, MD, Mary McDonell, MS, and Stephan Fihn, MD, MPH. VA Puget Sound Health Care System, Seattle, WA.

Objectives: Patient satisfaction has been positively associated with improved patient compliance and improved clinical outcomes and negatively associated with malpractice claims. Factors that have been found to be related to patient satisfaction include sociodemographic factors, payment source, both patient and physician rated health status and utilization measures. We examined relationship between continuity of care and patient satisfaction.

Methods: We surveyed 38,642 General Internal Medicine Clinic (GIMC) patients followed at 7 VAs. Data gathered included demographics, active medical problems and satisfaction with care using the Seattle Outpatient Satisfaction Questionnaire (SOSQ) which measures satisfaction with humanistic and organization aspects of care. Patients who reported angina, COPD, diabetes or hypertension also received condition-specific questionnaires (e.g. the Seattle Angina Questionnaire and the Seattle Obstructive Lung Disease Questionnaire) which include measures of condition-specific satisfaction. All scales were scored from 0 (worst) to 100 (best). Patients were also asked to rate their continuity of care.

Results: 14,865 patients responded with 11,711 reporting one or more of the following disease conditions: angina (n=5544), COPD (n=3189), diabetes (n=3249) or hypertension (n=8059). The percent of patients reporting seeing the same provider "always", "most of the time", "sometimes", and "rarely or never" were 38, 39, 14 and 6 respectively. There was no difference in the distribution of continuity scores between the disease conditions. Mean scores on both the SOSQ humanistic scale and condition-specific scales were strongly related to perceived continuity of care with satisfaction scores ranging from 86.7 to 61.4 among veterans who reported "always" seeing the same provider. Satisfaction scores among veterans who reported "rarely or never" seeing the same provider ranged from 69.5 to 41.9 (p<.001). These findings persisted after adjusting for age, education, race, income, VA facility, and length of time receiving care at the VA and SF-36 scores.

Conclusions: Continuity with the same provider is highly related to Patients' general and condition-specific satisfaction.

Impact: Since higher patient satisfaction has been associated with improved outcomes in chronic disease and improved medical compliance efforts to improve patient satisfaction might be reasonable interventions for improving outcomes. Further studies are needed to evaluate the contribution of various components of continuity of care (for example convenience, access, ease of negotiating the system, etc) to patient satisfaction.

HSR&D Funded: SDR 96-002

30. A Disease-Targeted Measure of Health-Related Quality of Life (HRQOL) for Patients with Chronic Liver Disease the LDQOL 1.0.

Ian Gralnek,MD, MSHS. West Los Angeles VA Medical Center, Los Angeles, CA. RD Hays, HR Rosen, EB Keeffee, DM Jensen, and P Martin.

Objectives: The development and validation of a patient-centered HRQOL outcomes measure is timely and needed for individuals with chronic liver disease. Disease-targeted measures can capture small, yet clinically meaningful changes in patients' health status due to an intervention or disease progression that a generic instrument may fail to detect. Therefore, the objective of this study is to evaluate the psychometric properties (reliability and validity) of a newly developed disease-targeted HRQOL instrument (the LDQOL 1.0) for individuals with chronic liver disease.

Methods: Disease-targeted items in the LDQOL 1.0 were developed from focus groups of patients with chronic liver disease awaiting liver transplantation, expert hepatology panel input, and an extensive review of the literature. Cognitive interviews were conducted to detect potential problems with instrument design or wording of items. The HRQOL instrument was then constructed consisting of 36 generic items (SF-36) supplemented with 77 disease-targeted items. A multicenter, cross-sectional field test was conducted.

Results: 221 consecutive ambulatory adult patients being evaluated for liver transplantation participated in this field test (64.1% male; median age = 51 years (range 23-78 years); 68.9% white, 6.8% Asian/Pacific Islander, 3.9% frican-American, 1.9% Native American, 18.5% other or multiracial). The LDQOL 1.0 is a self-report measure that includes 21 multi-item scales (number of items): physical functioning (10), role limitations-physical (4), pain (2), liver disease-related symptoms (19), emotional well-being (7), role imitations-emotional (3), energy (4), cognitive function (6), memory (4), concentration 3), hopelessness (7), loneliness (6), stigma of liver disease (8), social function (2), quality of social interaction (5), sexual function (3), sleep 6), general health perceptions (7), health distress (4), effects of liver disease 9), and impact of liver disease (4). Internal consistency reliabilities (Cronbach's alpha) ranged from 0.67 to 0.95 (median=0.86); 20/21 reliability estimates were excellent, alpha >= 0.70. All 21 scales were significantly (p<0.05) associated with self-reported severity of symptoms and 4 scales with duration of liver disease (better HRQOL related to less severity and shorter duration of liver disease). Role limitations-physical was most strongly related to severity of symptoms (p<0.01); sleep was most strongly associated with duration of disease (p<0.05). Worse physical functioning (p<0.01), worse sexual functioning among males (p<0.01), role limitations-physical (p<0.01), more liver disease-related symptoms (p<0.05), and greater negative effects of liver disease (p<0.05) were all significantly associated with higher Child-Pugh class.

Conclusions: This multicenter study demonstrates the high degree of reliability and construct validity of the LDQOL 1.0 for individuals with chronic liver disease. This HRQOL outcomes instrument is able to measure significant impairment of daily functioning not detected by more traditional clinician-rated methods (e.g., Child-Pugh classification). The LDQOL 1.0 is now ready for implementation into prospective, longitudinal studies.

Impact: 1. The LDQOL 1.0 will allow for a better understanding of HRQOL in patients with chronic liver disease. 2. The LDQOL 1.0 fits well with the VHA's initiative to build a system of data collection that will integrate both generic and disease-targeted functional status instruments into a routine process of HRQOL data collection. 3. HRQOL data collection in chronic liver disease will allow for case mix comparisons, evaluation of changes in patient functional status over time and its potential relationship to processes of care, and generation of patient summary information for the clinician in their care of patients with chronic liver disease. 4. The LDQOL 1.0 may provide important information on resource utilization within the VA health care system such as response to therapeutic interventions (e.g., therapies for chronic viral hepatitis and liver transplantation).

31. Measuring the Job Satisfaction of Providers in VA Primary Care: the Seattle Provider Satisfaction Questionnaire (SPSQ)

Mary McDonell, MS. VA Puget Sound Health Care System, Seattle, WA. J Marshall. Stephan Fihn, MD, MPH. VA Puget Sound Health Care System, Seattle, WA. KE Kilpatrick, and DS Lessler.

Objectives: Determining the satisfaction of health care providers is critical given continual changes in organization and expectations that often dramatically affect providers and influence their perceptions about their ability to deliver high quality care. We developed and validated a survey to measure multiple dimensions of job satisfaction among VA primary care providers.

Methods: Open-ended interviews designed to elicit provider perceptions of organizational characteristics that contributed to work satisfaction were conducted with 20 providers from a large group practice and VAPSHCS. Interviews and published questionnaires were used to generate a prototype 78-item questionnaire. As part of the Ambulatory Care Quality Improvement Project (ACQUIP) pilot study, the survey was tested among 236 general internists at 8 facilities (VA and non-VA) and condensed to 50 items. The 50-item questionnaire has now been administered to 220 providers at 7 ACQUIP sites and 792 providers at 56 VA facilities participating in the PRIME program. We performed exploratory (EFA) and confirmatory factor analyses (CFA) to analyze dimensionality of the SPSQ. Convergent and discriminate validity of the SPSQ were assessed using CFA as an approximation of the multitrait-multimethod approach. ANOVA and linear regression were used to examine subscale and global satisfaction scores and to adjust for demographic characteristics. Scales were scored from 0 (least satisfied) to 100 (most satisfied).

Results: The sample of 1012 providers was comprised of physicians (69%), nurse practitioners (NPs) (22%) and physician assistants (PAs) (9%). 49% were female. Ages ranged from 20-65 years; 40% were between 36 and 45. 77% were Caucasian, 12% Asian, and 4% African American. 44% had been at their jobs for >5 years. Six dimensions (subscales) emerged from factor analysis and all demonstrated high internal consistency: clinical staff communication (Cronbach's alpha=.86); relationships with specialists (.89); hassle-free work environment (.89); patient characteristics (.77); philosophy of practice (.84); and colleagues (.84). The CFA also demonstrated both convergent and discriminant validity (p<.001). Mean scores for all scales were low: staff communication (38.6); specialists (41.5); assle-free (37.7); patient characteristics (49.3); philosophy (66.4); and colleagues (58.4). Subscale and global satisfaction scores did not differ significantly according to gender, age, ethnicity, time on the job or provider type (resident, staff MD, PA, NP). Comparing different VA facilities, there were significant differences for all scales that were most dramatic (i.e., >25 points) for philosophy and colleagues. When the six domains were entered into a regression model predicting global satisfaction, the philosophy domain (belief in organization's philosophy and ability to practice according to personal standards) accounted for 57% of the variance (p < .001). Clinic organization and clinical staff communication were also significantly related to overall satisfaction (p< .001).

Conclusions: The SPSQ is a reliable, valid measure of multiple domains of provider satisfaction. The extent to which a provider's practice standards and philosophy are aligned with the organizations is a key determinant of overall satisfaction.

Impact: The SPSQ is potentially useful for monitoring outcomes and evaluating changes in clinic organization.

HSR&D Funded: SDR 96-002

32. Patient Characteristics and Patterns of use of Lumbar Spine Radiographs: Results from the Veterans Health Study

Alfredo Selim,, MD, MPH. Boston VA Medical Center, Boston, MA. G Fincke. X Ren, PhD. Edith Nourse Rogers Memorial Veterans Hospital, Bedford, MA. A Lee, and C Skinner. Lewis Kazis, ScD. Edith Nourse Rogers Memorial Veterans Hospital, Bedford, MA.

Objectives: Understanding patient factors that affect patterns of use of lumbar spine films