medigraphic.com
Instituto Nacional de Ciencias Médicas y Nutrición Salvador Zubirán

2011, Number 2

<< Back Next >>

Rev Invest Clin 2011; 63 (2)

Validity and reliability of mammographic interpretation by Mexican radiologists, using the BI-RADS system

Torres-Mejía G, Villaseñor-Navarro Y, Yunes-Díaz E, Ángeles-Llerenas A, Martínez-Montañez OG, Lazcano-Ponce E

Language: Spanish
References: 57
Page: 124-134
PDF size: 141.68 Kb.


ABSTRACT

Objective. Mammographic interpretation using the BIRADS system determines if a patient will continue in the regular screening program or needs additional studies for breast cancer diagnosis, hence the importance of its evaluation. Sensitivity, specificity, diagnostic accuracy of mammographic interpretation and inter- and intra-observer variation, were assessed in a random sample of 29 radiologists from the Mexican Ministry of Health. Material and methods. Eighty diagnostic and screening mammographic studies were selected from the National Cancer Institute in Mexico City. Under the same conditions, two interpretations using the BI-RADS system were performed by each of the participating radiologists. Results. Sensitivity in the first and second measurement was 72 and 74% respectively, while the specificity was 80% for the first and 82% for second. Multivariate analysis showed a positive association between the last year number of interpreted mammograms, the number of courses taken and diagnostic accuracy (β = 0.00002, 95% CI 0.000004, 0.00003, p = 0.02, β = 0.005, CI 95 % -0.0004, 0.01, p = 0.07, respectively). Inter-observer agreement was low in both measurements (κ = 0.24, κ = 0.25, respectively). However, after combining BI-RADS categories in 2, agreement increased to 0.46 for both measurements. The intra-observer agreement was good (κ = 0.67). Conclusions.The number of mammographic studies interpreted the previous year is a good measure of the experience of the radiologist and is reflected in the diagnostic accuracy of mammographic interpretation. Courses on mammographic interpretation also have a positive impact on performance.


REFERENCES

  1. Moreira C, Svoboda K, Poulos A, Taylor R, Page A, Rickard M. Comparison of validity and reliability of two image classification systems for the assessment of mammogram quality. J Med Screen 2005; 12: 38-42.

  2. Bigenwald RZ, Warner E, Gunasekara A, Hill KA, Causer PA, Messner SJ, et al. Is mammography adequate for screening women with inherited BRCA mutations and low breast density? Cancer Epidemiol Biomarkers Prev 2008; 17: 706-11.

  3. Yankaskas BC, Klabunde CN, Ancelle-Park R, Renner G, Wang H, Fracheboud J, et al. International Breast Cancer Screening Network. International comparison of performance measures for screening mammography: can it be done? J Med Screen 2004; 11: 187-93.

  4. Barlow WE, Chi C, Carney PA, Taplin SH, D’Orsi C, Cutter G, et al. Accuracy of screening mammography interpretation by characteristics of radiologists. J Natl Cancer Inst 2004; 96: 1840-50.

  5. Uematsu T. Screening and diagnosis of breast cancer in augmented women. Breast Cancer 2008; 15: 159-64.

  6. Blanks RG, Moss SM, McGahan CE, Quinn MJ, Babb PJ. Effect of NHS breast screening programme on mortality from breast cancer in England and Wales, 1990-8: comparison of observed with predicted mortality. BMJ 2000; 321: 665-9.

  7. Duffy SW, Tabar L, Chen HH, Holmqvist M, Yen MF, Abdsalah S, et al. The impact of organized mammographic service screening on breast carcinoma mortality in seven Swedish counties. Cancer 2002; 95: 458-69.

  8. Kerlikowske K. Efficacy of screening mammography among women aged 40 to 49 years and 50 to 69 years: comparison of relative and absolute benefit. J Natl Cancer Inst Monogr 1997; (22): 79-86.

  9. Sarkeala T, Anttila A, Saarenmaa I, Hakama M. Validity of process indicators of screening for breast cancer to predict mortality reduction. J Med Screen 2005; 12: 33-7.

  10. Preventive Services Task Force. Screening for breast cancer: U.S. Preventive Services Task Force recommendation statement. Ann Intern Med 2009; 151: 716-26.

  11. Kopans DB. The recent US preventive services task force guidelines are not supported by the scientific evidence and should be rescinded. J Am Coll Radiol 2010; 7: 260-4.

  12. Quanstrum KH, Hayward RA. Lessons from the mammography wars. N Engl J Med 2010; 363: 1076-9.

  13. Mishra SI, Bastani R, Crespi CM, Chang LC, Luce PH, Baquet CR. Results of a Randomized Trial to Increase Mammogram Usage among Samoan Women. Cancer Epidemiol Biomarkers Prev 2007; 16: 2594-604.

  14. Shen Y, Parmigiani G. A model-based comparison of breast cancer screening strategies: Mammograms and clinical breast examinations. Cancer Epidemiol Biomarkers Prev 2005; 14: 529-32.

  15. Brandan ME, Ruiz-Trejo C, Verdejo-Silva M, Guevara M, Lozano- Zalce H, Madero-Preciado L, et al. Evaluation of equipment performance, patient dose, imaging quality, and diagnostic coincidence in five Mexico City mammography services. Arch Med Res 2004; 35(1): 24-30.

  16. Obenauer S, Hermann KP, Grabbe E. Applications and literature review of the BI-RADS classification. Eur Radiol 2005; 15: 1027-36.

  17. Lozano R, Gómez-Dantés H, Arreola-Ornelas H, Méndez O, Knaul FM. Tendencias en la mortalidad por cáncer de mama en México, 1979-2006. Observatorio de la Salud. Documento de trabajo. Competitividad y Salud, Fundación Mexicana para la Salud 2008.

  18. Programa Nacional de Salud 2007-2012. Secretaría de Salud. México. Disponible en: http://portal.salud.gob.mx/sites/salud/ descargas/pdf/pns_version_completa.pdf [Consultado 28 de abril 2010].

  19. Bassett LW, Cardenosa G, D’Orsi CJ, Dempsey PJ, Dershaw DD, Destouet JM, et al. Risk of risk-based mammography screening, ages 40-49. American College of Radiology Task Force on Breast Cancer. J Clin Oncol 1999; 17: 735-8.

  20. McKay C, Hart CL, Erbacher G. Objectivity and accuracy of mammogram interpretation using the BI-RADS final assessment categories in 40- to 49-year-old women. J Am Osteopath Assoc 2000; 100: 615-20.

  21. Wang J, Shih TT, Hsu JC, Li YW. The evaluation of false negative mammography from malignant and benign breast lesions. Clin Imaging 2000; 24: 96-103.

  22. Chida K, Zuguchi M, Sai M, Saito H, Yamada T, Ishibashi T, et al. Optimization of tube potential-filter combinations for film-screen mammography: a contrast detail phantom study. Clin Imaging 2005; 29: 246-50.

  23. Disponible en: http://www.conapo.gob.mx/

  24. Comisión Federal para la Protección contra Riesgos Sanitarios. Normas Oficiales Mexicanas [NOM-229-SSA1-2002, monografía en internet]. México COFEPRIS. Disponible en: http:// www.cofepris.gob.mx/work/sites/cfp/resources/LocalContent/ 596/5/229ssa1.pdf [Consultado 28 de abril 2010].

  25. Aitken Z, Walker K, Stegeman BH, Wark PA, Moss SM, Mc- Cormack VA, Silva Idos S. Mammographic density and markers of socioeconomic status: a cross-sectional study. BMC Cancer 2010; 10: 35.

  26. Streiner DL, Norman GR. Health Measurement Scales: A practical guide to their development and use. New York: Oxford University Press; 1995, p. 79-96.

  27. Feinstein AR. A bibliography of publications on observer variability. J Chron Dis 1985; 38: 619-32.

  28. Raab SS. Diagnostic accuracy in cytopatology. Diag Cytopathol 1994; 10: 68-75.

  29. Stata 8. Statistics/data analysis. Stata Corporation, 702 University Drive East. College Station. Tx 778740, U.S.A.

  30. Beam CA, Layde PM, Sullivan DC. Variability in the interpretation of screening mammograms by US radiologists. Findings from a national sample. Arch Intern Med 1996; 156: 209-13.

  31. Brodersen J, Thorsen H, Cockburn J. The adequacy of measurement of short and long-term consequences of false-positive screening mammography. J Med Screening 2004; 11: 39-44.

  32. Mandelblatt JS, Cronin KA, Bailey S, Berry DA, De Koning HJ, Draisma G, et al. Breast Cancer Working Group of the Cancer Intervention and Surveillance Modeling Network. Effects of mammography screening under different screening schedules: model estimates of potential benefits and harms. Ann Intern Med 2009; 151: 738-47.

  33. Nelson HD, Tyne K, Naik A, Bougatsos C, Chan B, Nygren P, Humphrey L. Screening for Breast Cancer: Systematic Evidence Review Update for the US Preventive Services Task Force. Ann Intern Med 2009; 151: 727-37.

  34. Department of Health. NHS Cancer Screening Programs. Breast screening programme 2000-2001.

  35. Weil JG, Hawker JI. Positive findings of mammography may lead to suicide. BMJ 1997; 314: 754-5.

  36. Wang J, Shih TT, Hsu JC, Li YW. The evaluation of false negative mammography from malignant and benign breast lesions. J Clinical Imaging 2000; 24: 96-103.

  37. Mandelson MT, Oestreicher N, Porter PL, White D, Finder CA, Taplin SH, et al. Breast density as a predictor of mammographic detection: comparison of interval- and screen-detected cancers. J Natl Cancer Inst 2000; 92: 1081-7.

  38. Roger P, Delfour C, Ragu N, Serre I, Baldet P, Taourel P. Carcinoma with false negative mammogram: when and how? J Radiol 2004; 85: 2063-7.

  39. Johns PC, Yaffe MJ. X-ray characterization of normal and neoplastic breast tissues. Phys Med Biol 1987; 32: 675-95.

  40. Sala E, Warren R, McCann J, Duffy S, Day N, Luben R. Mammographic parenchymal patterns and mode of detection: implications for the breast screening programme. J Med Screen 1998; 5: 207-12.

  41. Smith-Bindman R, Chu P, Miglioretti DL, Quale C, Rosenberg RD, Cutter G, et al. Physician predictors of mammographic accuracy. J Natl Cancer Inst 2005; 97: 358-67.

  42. 42 . Norma Oficial Mexicana (NOM-041SSA2-2002), para la prevención, diagnóstico, tratamiento, control y vigilancia epidemiológica del cáncer de mama. Secretaría de Salud. Normas Oficiales Mexicanas [NOM-041-SSA2-2002, monografía en internet]. México, SS. Disponible en: http://bibliotecas.salud.gob.mx/gsdl/collect/nomssa/index/assoc/HASHbe3f.dir/doc.pdf [Consultado 28 de abril 2010].

  43. Kan L, Olivotto I, Burhenne LW, Sickles E, Coldman A. Standardized abnormal interpretation and cancer detection ratios to assess reading volume and reader performance in a breast screening program. Radiol 2000; 215: 563-7.

  44. Sickles E, Wolverton D, Dee K. Performance parameters for screening and diagnostic mammography: specialist and general radiologists. Radiol 2002; 224: 861-9.

  45. Beam CA, Layde PM, Sullivan DC. Variability in the interpretation of screening mammograms by US radiologists. Findings from a national sample. Arch Intern Med 1996; 156: 209-13.

  46. Beam C, Conant E, Sickles E. Association of volume and volume- independent factors with accuracy in screening mammogram interpretation. J Natl Cancer Inst 2003; 95: 282-90.

  47. Molins E, Maciá F, Ferrer F, Maristany MT, Castells X. Association between radiologists’ experience and accuracy in interpreting screening mammograms. BMC Health Serv Res 2008; 8: 91.

  48. Van Engen R, Young K, Bosmans H, Thijssen M. The European protocol for the quality control of the physical and technical aspects of mammography screening. Part B: Digital mammography. In: The Fourth Edition of the European Guidelines for Breast Cancer Screening. European Commission. Available from: http://www.euref.org [Accessed 19 August 2009].

  49. Skaane P, Young K, Skjennald A. Population based mammography screening: comparison of screen film and full-field digital mammography with soft-copy reading-The Oslo I study. Radiol 2003; 229: 877-84.

  50. Skaane P, Skjennald A. Screen-film mammography versus full-field digital mammography with soft-copy reading: randomized trial in a population-based screening program-The Oslo II Study. Radiol 2004; 232: 197-204.

  51. Peer S, Faulkner K, Torbica P, Peer R, Busch HP, Vetter S, et al. Relevant training issues for introduction of digital radiology: results of a survey. Radiat Prot Dosim 2005; 117: 154-61.

  52. Van Ongeval C, Van Steen A, Bosmans H. Teaching syllabus for radiological aspects of breast cancer screening with digital mammography. Radiat Prot Dosimetry 2008; 129: 191-4.

  53. Moss SM, Blanks RG, Bennett RL. Is radiologists’ volume of mammography reading related to accuracy? A critical review of the literature. Clin Radiol 2005; 60: 623-6.

  54. Berg WA, Campassi C, Langenberg P, Sexton MJ. Breast Imaging Reporting and Data System: inter- and intraobserver variability in feature analysis and final assessment. AJR 2000; 174: 1769-77.

  55. Baker JA, Kornguth PJ, Floyd CE Jr. Breast imaging reporting and data system standardized mammography lexicon: observer variability in lesion description. Am J Roentgenol 1996; 166: 773-8.

  56. Orel SG, Kay N, Reynolds C, Sullivan DC. BI-RADS categorization as a predictor of malignancy. Radiol 1999; 211: 845-50.

  57. Kerlikowske K, Grady D, Barclay J, Frankel SD, Ominsky SH, Sickles EA, et al. Variability and accuracy in mammographic interpretation using the American College of Radiology breast imaging reporting and data system. J Natl Cancer Inst 1998; 90: 1801-9.




2020     |     www.medigraphic.com