skip to page content
Talk to the Veterans Crisis Line now
U.S. flag
An official website of the United States government

Health Services Research & Development

Go to the ORD website
Go to the QUERI website

2008 HSR&D National Meeting Abstract


National Meeting 2008

3048 — Psychometric Validation of Readiness-To-Change Scales Based on the Promoting Action on Research Implementation in Health Systems (PARiHS) Model

Helfrich CD (IHD-QUERI), Li Y (IHD-QUERI)

Objectives:
IHD-QuERI developed Readiness-To-Change (RTC) survey scales to assess factors thought to determine organizational readiness to implement evidence-based changes to clinical practice. The objectives are to assess psychometric properties of the RTC scales and to recommend revisions to improve reliability and parsimony.

Methods:
Data were 113 survey responses from 17 VAMCs collected for three quality improvement and research projects. The same 77-item RTC scales were used in each. The RTC scales were based on the Promotion Action in Research Implementation in Health Services (PARiHS) model. Survey items were divided among three scales, each representing one of three main constructs of PARiHS: Evidence, Context and Facilitation. The corresponding scales include four, six, and nine subscales, each comprising 2 to 6 items. We conducted item analyses and scale reliability to assess convergent and divergent validities of subscales. The underlying factor structure of scales was assessed using exploratory factor analysis.

Results:
Reliability was high for the Context (alpha = 0.87 – 0.94) and Facilitation subscales (alpha = 0.84 – 0.94), and modest for the Evidence subscales (alpha = 0.70 – 0.75). Item-rest correlations were 0.41 to 0.90, supporting their inclusion in subscales. High cross-scale correlations (e.g., Pearson’s r > 0.50) were seen for some conceptually related items, such as leadership culture of the Context scale, and leadership characteristics of the Facilitation scale. Exploratory factor analysis of subscales revealed three distinct factors largely corresponding to the three constructs of the PARiHS. However, the Facilitation "leadership" subscale of the Facilitation scale loaded onto the Context factor, and "resources" subscale of the Context scale failed to load on any factor. Factor loadings and uniqueness statistics suggested that “patient preference” subscale of the Evidence scale may be a distinct construct.

Implications:
Most subscales of the RTC survey are reasonably reliable, and conform to the conceptual model they are based upon. Reliability and parsimony of the scales may be improved by revising items cross-loaded on multiple scales, and the "resources" and "patient preference" subscales warrant further development.

Impacts:
Theoretical models can only guide research and quality improvement activities to the extent that constructs can be operationalized. For this, well-validated instruments are essential.


Questions about the HSR&D website? Email the Web Team

Any health information on this website is strictly for informational purposes and is not intended as medical advice. It should not be used to diagnose or treat any condition.