Development and Use of Checklists for Assessment of Medical Students in Clinical Examinations on Real Patients: A preliminary study

Gamal  E H El Shallaly; Eltayeb  A Ali; Noha  O Ahmad

doi:10.52981/sjms.v4i1.922

Gamal E H El Shallaly Consultant surgeon, department of surgery, University of Alzaem Alazhari
Eltayeb A Ali Khartoum North Teaching Hospital
Noha O Ahmad Khartoum North Teaching Hospital

DOI: https://doi.org/10.52981/sjms.v4i1.922

Keywords: erformance, objective structured simulated patients

Abstract

Background Clinical performance examinations (CPE) are important methods for assessing medical students and postgraduate medical trainees. Unfortunately, assessment (scoring) in these exams as it is practiced in most medical schools is based mainly on the general impression and level of experience of the examiner. Hence, it has the disadvantage of being non-structured, subjective, and sometimes highly
biased. The objective of this study was to develop objective structured tools (checklists), use them in the clinical examination, and to compare their scores to those given by the conventional way.
Methods Case-specific checklists were developed for some common long and short clinical examination cases. These were tried in the final undergraduate surgery exam at Alazhari University, August 2008. Scores (marks) given to the same student, using the conventional and the checklist systems were compared using the chi square and correlation statistics. Questionnaires were filled by the examiners after using the checklists.
Results Checklist and conventional scores were strongly correlated in the long case exams. A significant difference between the scores was, however, noted in the short case exams. Care should be taken in interpretation because of the small number of data. Evaluators felt that the checklist system was more objective and structured and hence fairer than the conventional method. Although checklist final scores took a bit longer time to calculate, that was not significant practically. Examiners gave valuable feedback regarding the construction and the use of checklists.

Conclusion The use of checklists in the clinical examination was more objective, more structured, and more accurate than the conventional method. The development of checklists requires hard team work and
frequent updating and use to develop experience. We propose using checklists as alternative tools of assessment with many advantages over the conventional method, and to prepare the examination culture to adopt the OSCE

References

1. Stokes J. The clinical examination -assessment of clinicalskills, medical education booklet no. 2 (Dundee, Association for the Study of Medical Education.
2. Sood R. Long case examination. Can it be improved? Journal, Indian Academy of Clinical Medicine 2001; 2 (4): 251-55
3. Gleeson F. Assessment of clinical competence using the objective structured long examination record (OSLER). Medical Teacher 1997; 19: 7-14.
4. Harden RM, Stevenson M, Wilson DW et al. Assessment of clinical competencies using objective structured clinical examination. Br J Med Educ 1975; 1:447 451
5. M O’Comor, RC Mc Graw. Clinical skills training: developing objective assessment instruments. Medical Education 1997; 31 (5): 359-363.
6. Frank C. Evidence based checklists for objective structured clinical examination. BMJ 2006; 333: 546-548.
7. Wass V, Jones R, Van der vleuten. Standardized or real patients to test clinical competence? The long case revisited. Medical Education 2001; 35 (4): 321-25