View : 828 Download: 0
An experimental comparison of rater performance on an SP-based clinical skills exam
- Title
- An experimental comparison of rater performance on an SP-based clinical skills exam
- Authors
- Jae J.H.; Kreiter C.D.; Park H.; Ferguson K.J.
- Ewha Authors
- 한재진; 박혜숙
- SCOPUS Author ID
- 한재진
![scopus](/images/layout/icon2.png)
; 박혜숙![scopus](/images/layout/icon2.png)
![scopus](/images/layout/icon2.png)
- Issue Date
- 2006
- Journal Title
- Teaching and Learning in Medicine
- ISSN
- 1040-1334
- Citation
- Teaching and Learning in Medicine vol. 18, no. 4, pp. 304 - 309
- Indexed
- SCI; SCIE; SCOPUS
![scopus](/images/layout/scopus2.gif)
- Document Type
- Article
- Abstract
- Background: Research has provided only limited information regarding how best to structure rater training and the best rating formats for a standardized-patient (SP) based assessment. Purpose: The purpose of this study was to determine the efficacy of rater discussions as an expert rater training method and to compare the expert's rating of recorded video performances with real-time SP ratings on both a global and checklist evaluation instrument. Methods: We implemented an experimental study of a discussion-based expert rater training method to compare generalizability and interrater reliability of trained experts, untrained experts, and SP raters in a 4th-year clinical skills exam. Results: In terms of reliability, SP raters did as well as expert raters on the checklist and better than expert raters on global ratings. For the expert raters, training via a discussion method did not significantly improve the reliability of checklist ratings or global ratings. Within the experts groups, those with checklists performed better than those with global ratings. Conclusions: For SP-based exams designed to assess basic clinical skills, SP ratings appear to perform as well or better than expert ratings. Discussion-based expert training yielded no improvements in expert rater performance, and expert checklist scores generated more reliable results than the expert global rating scores. Copyright © 2006 by Lawrence Erlbaum Associates, Inc.
- DOI
- 10.1207/s15328015tlm1804_5
- Appears in Collections:
- 의과대학 > 의학과 > Journal papers
- Files in This Item:
There are no files associated with this item.
- Export
- RIS (EndNote)
- XLS (Excel)
- XML