medigraphic.com
ISSN 0016-3813 (Print)

2014, Number 1

<< Back Next >>

Gac Med Mex 2014; 150 (1)

Clinical competence evaluation using the objective structured clinical examination (OSCE) in medical internship at UNAM

Trejo MJA, Martínez GA, Méndez RI, Morales LS, Ruiz PLC, Sánchez MM

Language: Spanish
References: 41
Page: 8-17
PDF size: 253.24 Kb.


ABSTRACT

Introduction: The Objective Structured Clinical Examination (OSCE) is a widely used measurement tool to assess clinical competence in the health sciences. There is little published evidence of its use in Mexican medical schools. Objective: To assess clinical competence in medical students with an OSCE, before and after the Medical Internship. Methods: Prospective cohort study, pre- post-test research design. The assessed population was medical students at UNAM Faculty of Medicine in Mexico in their Internship year. The instrument was an 18-stations OSCE, three stations per academic area of the Internship curriculum. Results: We assessed the clinical competence of 278 students in a pretest OSCE when starting the Internship year, and tested them 10 months later with an equivalent post-test OSCE. The sample of students was 30.4% of the total Internship population. Test reliability with Cronbach’s alpha was 0.62 in the pre-test and 0.64 in the post-test. The global mean score in the pretest OSCE was 55.6 ± 6.6 and in the post-test 63.2 ± 5.7 (p ‹ 0.001), with a Cohen’s d of 1.2. Conclusions: The clinical competence of medical students measured with an OSCE is higher after the medical internship year. This difference suggests that the internship can influence the development of clinical competence in medical students.


REFERENCES

  1. Stufflebeam D, Shinkfield E. Evaluación sistemática. Barcelona: Paidós; 1993.

  2. Holmboe ES. Faculty and the observation of trainees’ clinical skills: problems and opportunities. Acad Med. 2004;79:16-22.

  3. Norcini J. The death of the long case? Br Med J. 2002;324:408-9.

  4. Williams R, Klamen D, MacGaghie W. Congnitive, social and environmental sources biases in clinical performance ratings. Teach Learn Med. 2003;15(4):270-92.

  5. Elstein AS, Shulman LS, Sprafka SA. Medical Problem Solving. Cambridge: Harvard University Press; 1978. p. 292-4.

  6. Larios MH, Trejo MJ, Cortés GT. Evaluación de la Competencia Clínica. Rev Med lMSS. 1998;36(1):79-84.

  7. Norman G. Defining Competence: A Methodological Review. En: Neufeld VR, Norman GR, eds. Assessing Clinical Competence. Nueva York: Springer Publishing Company; 1985. p. 15-35.

  8. Neufeld VR. Historical Perspectives on clinical competence. En: Neufeld VR, Norman GR, eds. Assessing Clinical Competence. Nueva York: Springer Publishing Company; 1985. p. 3-14.

  9. Harden RM, Stevenson WM, Downie W, Wilson GM. Assessment of Clinical Competence Using an Objective Structured Examination (OSCE). Br Med J. 1975;1:447-51.

  10. Newble DI, Swanson DB. Psychometric characteristics of the Objective Structured Clinical Examination. Med Educ. 1988;22:325-34.

  11. Newble D. Techniques for measuring clinical competence: Objective Structured Clinical Examinations. Med Educ. 2004;38:199-203.

  12. Larios H, Trejo J, Martínez N, Cortés T, Velasco T, Hernández A. Desarrollo de la Competencia Clínica durante el Internado Médico. Rev Ed Sup. 2000;XXIX(3):115-28.

  13. Eva KW, Neville AJ, Norman GR. Exploring the etiology of content specificity: factors influencing analogic transfer and problem solving. Acad Med. 1988;73(10):S1-5.

  14. Collins J, Harden RM. Real patients, simulated patients and simulators in clinical examinations. Med Teach. 1988;20(6):508-21.

  15. Reznick R, Smee S, Rothman A, et al. An Objective Structured Clinical Examination for the licenciate: Report of the Pilot Project of the Medical Council of Canada. Acad Med. 1992;67(8):487-94.

  16. Sloan DA, Donelly MB, Schwartz RW, Strodel WE. The objective structured clinical examination. The new gold standard for evaluating postgraduate clinical performance. Ann Surg. 1995;222(6):735-42.

  17. De la Fuente JR, Piña E, Gutiérrez H. La formación del médico del siglo XXI y el Plan Único de Estudios de la Facultad de Medicina de la Universidad Nacional Autónoma de México. Educ Med Salud. 1994;28(3):331-40.

  18. Cummings SR. Diseño de un nuevo estudio: II Estudios de cohortes. En: Hulley SB, Cummings SR, eds. Diseño de la investigación científica. Un enfoque epidemiológico. Barcelona: Editorial Doyma; 1993. p. 69-81.

  19. Campbell D, Stanley J. Diseños experimentales y cuasi experimentales en la investigación social. Argentina: Amorrortu Editores; 1996. p. 20-8.

  20. Hodges B, Hanson M, Mcaughton N, Regehr G. Creating, monitoring and improving a Psychiatry OSCE. Acad Psych. 2002;26(3):134-61.

  21. Cohen J. Chapter 1.4. The effect size. En: Cohen J. Statistical power analysis for the behavioral sciences. 2.a ed. Nueva Jersey: Lawrence Earlbaum Associates; 1988. p. 8-14.

  22. Sistema Nacional de Información en Salud. Secretaría de Salud. [Internet] Disponible en: http//www.sinais.salud.gob.mx/estadisticasportema.html.

  23. Sánchez M, Durante I, Morales S, Lozano R, Martínez A, Graue E. Plan de Estudios 2010 de la Facultad de Medicina de la Universidad Nacional Autónoma de México. Gac Med Mex. 2011;147(2):152-8.

  24. Short M, Jorgensen J, Edwards J, Blakenship R, Roth B. Assessing Intern Core Competencies with an Objective Structured Clinical Examination. J Grad Med Educ. 2009;1(1):30-6.

  25. Townsend AH, Mcllvenny S, Miller CJ, Dunn EV. The use of an objective structured clinical examination (OSCE) for formative and summative assessment in a general practice clinical attachment and its relationship to final medical school examination performance. Med Educ. 2001; 35:841-6.

  26. Sullivan GM, Feinn R. Using effect size - or why the P value is not enough. J Grad Med Educ. 2012;4(3):279-82.

  27. Norman G: The effectiveness and effects of effect sizes. Adv Health Sci Educ Theory Pract. 2003;8(3):183-7.

  28. Trejo JA, Larios H, Cortés MT, Martínez N, Gracia O. Competencia Clínica en el área de Medicina Familiar. Arch Med Fam. 2000;2(3):65-74.

  29. Manual Departamental Medicina General I. Programa Académico teóricopráctico. Departamento de tercer año, SECISS, Facultad de Medicina, Universidad Nacional Autónoma de México, Ciudad Universitaria, México, enero de 2012.

  30. Manual Departamental Medicina General II. Programa Académico teóricopráctico. Departamento de cuarto año, SECISS, Facultad de Medicina, Universidad Nacional Autónoma de México, Ciudad Universitaria, México, enero de 2012.

  31. Larios H, Trejo J, Méndez I. Examen Profesional con el Examen Clínico Objetivo Estructurado. Rev Educ Sup. 2005;34(4):7-17.

  32. Streiner DL, Norman G. Reliability. En: Streiner DL, Norman G, eds. Health measurement scales: A practical guide to their development and use. Oxford: Oxford University Press; 2003. p. 126-52.

  33. Iramaneerat Ch, Yudkowsky R, Myford C, Downing S. Quality control of an OSCE using generalizability theory and many-faceted Rasch measurement. Adv Health Sci Educ. 2008;13:479-93.

  34. Patricio M. A Best Evidence Medical Education (BEME) Systematic Review on the feasibility, reliability and validity of the Objective Structured Clinical Examination (OSCE) in undergraduate medical studies. Tesis Doctoral, Facultad de Medicina, Universidad de Lisboa. 2012. p. 85-6. [Internet] Disponible en: http://tinyurl.com/c5c7cbs.

  35. Van der Vleuten C, Swanson DB. Assessment of clinical skills with standardized patients: State of the Art. Teach Learn Med. 1990;2(2): 58-76.

  36. Harden RM, Gleeson FA. Assessment of Clinical Competence Using an Objective Structured Clinical Examination (OSCE). Med Educ. 1979;13:41-54.

  37. Rethans JJ, Norcini JJ, Barón-Maldonado M, et al. The relationship between competence and performance: implications for assessing practice performance. Med Educ. 2002;36:901-9.

  38. Fraenkel JR, Wallen NE. Internal Validity. En: Fraenkel JR, Wallen NE. How to Design and Evaluate Research in Education. Nueva York: McGraw Hill; 2012. p. 166-83.

  39. Van der Vleuten CPM. The assessment of professional competence: developments, research and practical implications. Adv Health Sci Educ. 1996;1:41-67.

  40. Mavis BE, Henry RC. Between a rock and a hard place: finding a place for the OSCE in medical education. Med Educ. 2002;36:408-9.

  41. Hill DA, Guinea Al, McCarthy WH. Formative assessment: a student perspective. Med Educ. 1994;28:394-9.




2020     |     www.medigraphic.com