medigraphic.com
ISSN 0016-3813 (Print)

2014, Number 1

<< Back Next >>

Gac Med Mex 2014; 150 (1)

Diagnostic assessment of knowledge and competencies in medical students at the end of the second year of medical school: the challenge of building an airplane while it’s flying

Martínez GA, Trejo MJA, Fortoul GTI, Flores HF, Morales LS, Sánchez MM

Language: Spanish
References: 41
Page: 35-48
PDF size: 283.35 Kb.


ABSTRACT

Introduction: In Latin America there is almost no published information about knowledge retention and formative assessment of competencies in medical students, during medical school training and curricular changes. Objective: To assess knowledge level and clinical competencies in medical students at the end of the second year in a new curriculum. Methods: Observational, cross-sectional study in UNAM Faculty of Medicine students. A diagnostic evaluation was performed in the first class of the “Plan of Studies 2010” curriculum, as part of an integral program evaluation strategy. The assessment had two components: theoretical and practical. Results: 456 (87%) of the 524 students that successfully completed the second year of Plan 2010 were assessed. The written test had 211 items, a mean score of 60 ± 14.5, mean difficulty index of 0.60, reliability with Cronbach’s alpha of 0.85. The OSCE mean global score was 58 ± 9, Cronbach’s alpha of 0.36, and G-coefficient of 0.48, and results were provided for each station. Results by area of knowledge, course, and station were reported. Conclusions: The results in general are acceptable, compared with previous written evaluations at the end of the second year, suggesting that the new program is achieving its educational goals. Competencies were formally assessed for the first time in our Institution, establishing a starting point for follow-up. The study provided useful information to the institution, teachers and students.


REFERENCES

  1. Morales S, Petra MI, Cortés MT. El programa de alta exigencia académica en la Facultad de Medicina de la UNAM. Rev Educ Sup. 1999;XXVIII:1-5. [Internet] Consultado el 14 de diciembre de 2012. Disponible en: http://www.anuies.mx/servicios/p_anuies/publicaciones/revsup/ res109/txt1_5.htm.

  2. Graue-Wiechers E. Informe de Actividades 2008-2012. [Internet] Consultado el 1 de octubre de 2012. Disponible en: http://www.facmed. unam.mx/marco/index.php?dir_ver=113.

  3. Sánchez Mendiola M, Durante Montiel I, Morales López S, Lozano Sánchez R, Martínez González A, Graue Wiechers E. Plan de estudios 2010 de la Facultad de Medicina de la Universidad Nacional Autónoma de México. Gac Med Mex. 2011;147:152-8.

  4. Weurlander M, Söderbergb M, Schejac M, Hultb H, Wernerson A. Exploring formative assessment as a tool for learning: students’experiences of different methods of formative assessment. Assessment & Evaluation in Higher Education. 2012;37:747-60.

  5. Plan de Estudios 2010 y Programas Académicos de la Licenciatura de Médico Cirujano. Facultad de Medicina, Universidad Nacional Autónoma de México, 2010. [Internet] Disponible en: www.facmed.unam.mx.

  6. Downing SM. Twelve steps for effective test development. En: Downing SM, Haladyna TM, eds. Handbook of Test Development. New Jersey: Lawrence Erlbaum Associates; 2006. p. 3-25.

  7. Haladyna TM, Downing SM, Rodriguez MC. A Review of Multiple-Choice Item-Writing Guidelines for Classroom Assessment. Applied Measurement in Education. 2002;15:309-34.

  8. Fortoul-van der Goes TI, Morales-López S, Muñoz-Comonfort A, Jacobo- Méndez A, Varela-Ruíz M, Rodríguez-Lara V. Retención de los conocimientos básicos en cinco generaciones de alumnos que terminaron los dos primeros años del plan único de la carrera de médico cirujano en la Facultad de Medicina, UNAM (2007-2011). Inv Ed Med. 2012;1:170-5.

  9. Rodríguez R, Téllez VC, Martínez GA, Santana C. Retención de los conocimientos de ciencias básicas por los alumnos de medicina. Implicaciones educativas. Rev Fac Med UNAM. 1992;35:23-8.

  10. Guevara GR, Galván M, Muñoz CA. El desempeño académico de los estudiantes de la Facultad de Medicina en el primer año de la carrera. Gac Med Mex. 2007;143:27-32.

  11. Martínez GA, Gil MA, Rey CJ, Rodríguez CR. Nivel académico de los alumnos del Programa de Medicina General Integral (Plan A-36) y su comparación con los alumnos del Plan de Estudios 85. I. Una nueva estrategia para evaluar la calidad del proceso educativo. Rev Fac Med UNAM. 1997;40(6):222-9.

  12. Lazi´c E, Dujmovi´c J, Hren D. Retention of Basic Sciences Knowledge at Clinical Years of Medical Curriculum. Croat Med J. 2006;47:882-7.

  13. Kennedy WB, Kelley PR, Saffran M. Use of NBME examinations to assess retention of basic science knowledge. J Med Educ. 1981;56:167-73.

  14. Swanson DB, Case SM, Luecht RM, et al. Retention of basic science information by fourth-year medical students. Acad Med. 1996;71:80-2.

  15. Custers EJ. Long-term retention of basic science knowledge: a review study. Adv Health Sci Educ Theory Pract. 2010;15(1):109-28

  16. Farr MJ. The long-term retention of knowledge and skills. A cognitive and instructional perspective. Nueva York: Springer-Verlag; 1994.

  17. Last KS, Appleton J, Ferguson JDB, et al. The value of a questionnaire in assessing the acquisition and retention of basic science knowledge by dental students. Eur J Dent Educ. 2000;4:3-9.

  18. Woloschuk W, Mandin H, Harasym P, et al. Retention of basic science knowledge: a comparison between body system-based and clinical presentation curricula. Teach Learn Med. 2004;16(2):116-22.

  19. Logan JM, Thompson AJ, Marshak DW. Testing to enhance retention in human anatomy. Anat Sci Educ. 2011;4:243-8.

  20. D’Eon MF. Knowledge loss of medical students on first year basic science courses at the university of Saskatchewan. BMC Med Educ. 2006;6:5.

  21. Van der Vleuten CPM. The assessment of professional competence: developments, research and practical implications. Adv Health Sci Educ. 1996;1:41-67.

  22. Simon S, Volkan K, Hamann C, Duffey C, Fletcher S. The relationship between second-year medical students´OSCE scores and USMLE Step 1 scores. Med Teach. 2002;24:535-9.

  23. Larios MH, Trejo MJA, Martínez VN, Cortés MT, Velasco T, Hernández A. Desarrollo de la competencia clínica durante el internado médico. Rev Educ Sup. 2000;XXIX. [Internet] Consultado el 14 de diciembre de 2012. Disponible en: http://www.anuies.mx/servicios/p_anuies/publicaciones/ revsup/res115/info115.htm.

  24. Boehlecke B, Sperber AD, Kowlowitz V, Becker M, Contreras A, Mc-Gaghie WC. Smoking history-taking skills: a simple guide to teach medical students. Med Educ. 1996;30:283-9.

  25. Allen SS, Bland CJ, Harris IB, et al. Structured clinical teaching strategy. Med Teach. 1991;13:177-84.

  26. Lee KC, Dunlop D, Dolan NC. Do clinical breast examination skills improve during medical school? Acad Med. 1998;73:1013-9.

  27. Pilgrim C, Lannon C, Harris RP, Cogburn W, Fletcher SW. Improving clinical breast examination training in a medical school: a randomized controlled trial. J Gen Int Med. 1993;8:685-8.

  28. Hasle JL, Anderson DS, Szerlip HM. Analysis of the costs and benefits of using standardized patients to help teach physical diagnosis. Acad Med. 1994;69:567-70.

  29. Feickert JA, Harris IB, Anderson DC, et al. Senior medical students as simulated patients in an objective structured clinical examination: motivation and benefits. Med Teach. 1992;14:167-77.

  30. Anderson DC, Harris IB, Allen S, et al. Comparing students’ feedback about clinical instruction with their performances. Acad Med. 1991;66:29-34.

  31. Carpenter JL, McIntire D, Battles J, Wagner JM. Administration of a parallel, simultaneous objective structured clinical examination to accommodate a large class of students. Teach Learn Med. 1993;5:79-85.

  32. Townsend AH, Mcllvenny S, Miller CJ, Dunn EV. The use of an objective structured clinical examination (OSCE) for formative and summative assessment in a general practice clinical attachment and its relationship to final medical school examination performance. Med Educ. 2001;35:841-6.

  33. Short M, Jorgensen J, Edwards J, Blakenship R, Roth B. Assessing Intern Core Competencies with an Objective Structured Clinical Examination. J Grad Med Educ. 2009;1(1):30-6.

  34. Mavis BE, Henry RC. Between a rock and a hard place: finding a place for the OSCE in medical education. Med Educ. 2002;36:408-9.

  35. Ross JR, Hutcheon MA, Cohen R. Second-year students’ score improvement during an objective structured clinical examination. J Med Educ. 1987;62:857-9.

  36. Hamann C, Volkan K, Fishman M, Silvestri R, Simon S, Fletcher S. How well do second-year students learn physical diagnosis? Observational study of an objective structured clinical examination (OSCE). BMC Med Educ. 2002;2:1-11.

  37. Cohen R, Rothman AJ, Ross J, Poldre P. Validating an objective structured clinical examination (OSCE) as a method for selecting foreign medical graduates for a pre-internship program. Acad Med. 1991;9:S67-9.

  38. Petrusa ER, Blackwell TA, Rogers LP, et al. An objective measure of clinical performance. Am J Med. 1987;83:34-42.

  39. Prislin MD, Giglio M, Lewis EM, Ahearn S, Radecki S. Assessing the acquisition of core clinical skills through the use of serial standardized patient assessments. Acad Med. 2000;75(5):480-3.

  40. Patricio M. A Best Evidence Medical Education (BEME) Systematic Review on the feasibility, reliability and validity of the Objective Structured Clinical Examination (OSCE) in undergraduate medical studies. Tesis Doctoral, Facultad de Medicina, Universidad de Lisboa. 2012. [Internet] Disponible en: http://tinyurl.com/c5c7cbs.

  41. Rolfe I, McPherson J. Formative assessment: how am I doing? Lancet. 1995;345(8953):837-9.




2020     |     www.medigraphic.com