HSR&D Citation Abstract
Search | Search by Center | Search by Source | Keywords in Title
Validation of an observation instrument for measuring student engagement in health professions settings.
O'Malley KJ, Moran BJ, Haidet P, Seidel CL, Schneider V, Morgan RO, Kelly PA, Richards B. Validation of an observation instrument for measuring student engagement in health professions settings. Evaluation & the health professions. 2003 Mar 1; 26(1):86-103.
Documenting student engagement has received increased emphasis in medical schools, as teaching strategies are changing to include more student-to-student interactions. The purpose of this study was to develop and evaluate a measure of student engagement completed by independent observers that would not interfere with student learning time. Data from 3,182 observations completed by nine observers in 32 educational classroom settings with 23 different instructors were used to evaluate the interobserver reliability and gather validity evidence for our observational instrument, named the STROBE. Results indicated that interobserver agreement was good to excellent when observations were conducted simultaneously on randomly selected students in the same classroom (84% average agreement and 0.79 average kappa coefficient) and when observations were conducted on different randomly selected students (79% average agreement). Results also provided strong evidence for validity. Overall, findings indicate that the STROBE demonstrates promise for educational research and evaluation by documenting student engagement in medical education settings.