2017, Number 1
<< Back Next >>
Gac Med Mex 2017; 153 (1)
Diagnostic and formative assessment of competencies at the beginning of undergraduate medical internship
Martínez-González A, Lifshitz-Guinzberg A, Trejo-Mejía JA, Torruco-García U, Fortoul-van der Goes TI, Flores-Hernández F, Peña-Balderas J, Martínez-Franco AI, Hernández-Nava A, Elena-González D, Sánchez-Mendiola M
Language: Spanish
References: 35
Page: 6-15
PDF size: 112.04 Kb.
ABSTRACT
Introduction: Research on diagnostic and formative assessment competencies during undergraduate medical training is
scarce in Latin America.
Objective: To assess the level of clinical competence of students at the beginning of their medical
internship in a new curriculum.
Methods: This was an observational cross-sectional study in UNAM Faculty of Medicine
students in Mexico City: a formative assessment of the second class of Curriculum 2010 students as part of the integral
evaluation of the program. The assessment had two components: theoretical and practical.
Results: We assessed 577 students
(65.5%) of the 880 total population that finished the 9th semester of Curriculum 2010. The written exam consisted of
232 items, with a mean of 61.0 ± 19.6, a difficulty index of 0.61, and Cronbach’s alpha of 0.89. The mean of the objective
structured clinical examination (OSCE) was 62.2 ± 16.8, with a mean Cronbach’s alpha of 0.51. Results were analyzed by
knowledge area and exam stations.
Conclusions: The overall results provide evidence that students achieve sufficiently the
competencies established in the curriculum at the beginning of the internship, that they have the necessary foundation for
learning new and more complex information, and integrate it with existing knowledge to achieve significant learning and
continue their training.
REFERENCES
Sánchez-Mendiola M, Martínez-Franco AI, Lobato-Valverde M, Fernández- Saldívar F, Vives-Varela T, Martínez-González A. Evaluation of a Biomedical Informatics course for medical students: a pre-posttest study at UNAM Faculty of Medicine in Mexico. BMC Med Educ. 2015;15:64.
Sánchez-Mendiola M, Durante-Montiel I, Morales-López S, Lozano-Sánchez R, Martínez-González A, Graue-Wiechers E. Plan de Estudios 2010 de la Facultad de Medicina de la Universidad Nacional Autónoma de México. Gac Med Mex. 2011;147:152-8.
Miller D, Linn R, Gronlund N. Measurement and assessment in teaching. 11th ed. USA: Pearson; 2012.
Downing SM, Yudkowsky R. Introduction to assessment in the health professions. En: Downing S, Yudkowsky R, editores. Assesment in Health Professions Education. New York, NY.: Routledge; 2009. p. 1-21.
Weurlander M, Söderberg M, Scheja M, Hult H, Wernerson A. Exploring formative assessment as a tool for learning: students’ experiences of different methods of formative assessment. Assess Eval High Educ. 2012;37:747-60.
Downing S. Validity: on meaningful interpretation of assessment data. Med Educ. 2003;37:830-7.
Haladyna TM, Downing SM, Rodriguez MC. A review of multiple-choice item-writing guidelines for classroom assessment. Appl Meas Educ. 2002;15:309-33.
Trejo Mejía JA, Sánchez Mendiola M, Méndez Ramírez I, Martínez- González A. Análisis de la confiabilidad del examen clínico objetivo estructurado a través de la teoría de la generalizabilidad; 2016.
Martínez González A, Trejo Mejía JA, Fortoul van der Goes TI, Flores Hernández F, Morales López S, Sánchez Mendiola M. Evaluación diagnóstica de conocimientos y competencias en estudiantes de medicina al término del segundo año de la carrera: el reto de construir el avión mientras vuela. Gac Med Mex. 2014;150:35-48.
Greb AE, Brennan S, McParlane L, Page R, Bridge PD. Retention of medical genetics knowledge and skills by medical students. Genet Med. 2009;11:365-70.
Homaifar N, Mwesigye D, Tchwenko S, et al. Emergency obstetrics knowledge and practical skills retention among medical students in Rwanda following a short training course. Int J Gynaecol Obstet. 2013;120:195-9.
Last KS, Appleton J, Ferguson DB, Stevenson H. The value of a questionnaire in assessing the acquisition and retention of basic science knowledge by dental students. Eur J Dent Educ. 2000;4:3-9.
Woloschuk W, Mandin H, Harasym P, Lorscheider F, Brant R. Retention of basic science knowledge: a comparison between body systembased and clinical presentation curricula. Teach Learn Med. 2004;16: 116-22.
Hudelson P, Perron NJ, Perneger T. Using clinical vignettes to assess doctors’ and medical students’ ability to identify sociocultural factors affecting health and health care. Med Teach. 2011;33:e564-e571.
Gottfried EL, Kamoun M, Burke MD. Laboratory medicine education in United States medical schools. Am J Clin Pathol. 1993;100:594-8.
Marshall R, Cartwright N, Mattick K. Teaching and learning pathology: a critical review of the English literature. Med Educ. 2004;38:302-13.
Trejo Mejía JA, Martínez González A, Méndez Ramírez I, Morales López S, Ruiz Pérez LC, Sánchez Mendiola M. Evaluación de la competencia clínica con el examen clínico objetivo estructurado en el internado médico de la Universidad Nacional Autónoma de México. Gac Med Mex. 2014;150:8-17.
Brannick MT, Erol-Korkmaz HT, Prewett M. A systematic review of the reliability of objective structured clinical examination scores. Med Educ. 2011;45:1181-9.
Short MW, Jorgensen JE, Edwards JA, Blankenship RB, Roth BJ. Assessing intern core competencies with an objective structured clinical examination. J Grad Med Educ. 2009;1:30-6.
Martínez González A, Sánchez Mendiola M, Méndez Ramírez I, Trejo Mejía J. Grado de competencia clínica de siete generaciones de estudiantes al término del internado médico de pregrado; 2016;152:679-87.
Amaral F, Troncon LE de A. Retention of knowledge and clinical skills by medical students: a pro-spective, longitudinal, one-year study using basic pediatric cardiology as a model. 2013;6:48-54
Alexander C, Cameron A, Millar J, Szmidt N, Hanlon K, Cleland J. Can new doctors be prepared for practice? A review. Clin Teach. 2014;11:188-92.
Heaton A, Webb DJ, Maxwell SRJ. Undergraduate preparation for prescribing: the views of 2413 UK medical students and recent graduates. Br J Clin Pharmacol. 2008;66:128-34.
Wall D, Bolshaw A, Carolan J. From undergraduate medical education to pre-registration house officer year: how prepared are students? Med Teach. 2006;28:435-9.
Reilly BM. Physical examination in the care of medical inpatients: an observational study. Lancet. 2003;362:1100-5.
Sharma S. A single-blinded, direct observational study of PGY-1 interns and PGY-2 residents in evaluating their history-taking and physicalexamination skills. Perm J. 2011;15:23-9.
Ramani S. Twelve tips for excellent physical examination teaching. Med Teach. 2008;30:851-6.
McLaughlin K, Gregor L, Jones A, Coderre S. Can standardized patients replace physicians as OSCE examiners? BMC Med Educ. 2006;6:12.
Rothman AI, Cusimano M. A comparison of physician examiners’, standardized patients’, and communication experts’ ratings of international medical graduates’ English proficiency. Acad Med. 2000;75:1206-11.
Camarena Robles E, Hernández Torres F, Fajardo Dolci G. La comunicación humana y su relación con la queja médica. Rev CONAMED. 2011;16:141-7.
Harden RM, Laidlaw JM. Essential skills for a medical teacher: an introduction to teaching and learning in medicine. London: Churchill Livingstone - Elsevier; 2012.
Hattie J, Timperley H. The power of feedback. Rev Educ Res. 2007;77:81- 112.
Sandars J, Cleary TJ. Self-regulation theory: applications to medical education: AMEE Guide No. 58. Med Teach. 2011;33:875-86.
Karpicke JD, Blunt JR. Retrieval practice produces more learning than elaborative studying with concept mapping. Science. 2011;331: 772-5.
Pusic M V, Kessler D, Szyld D, Kalet A, Pecaric M, Boutis K. Experience curves as an organizing framework for deliberate practice in emergency medicine learning. Acad Emerg Med. 2012;19:1476-80.