2015, Number 6
<< Back Next >>
salud publica mex 2015; 57 (6)
Inter-rater reliability of measures to characterize the tobacco retail environment in Mexico
Hall MG, Kollath-Cattano C, Reynales-Shigematsu LM, Thrasher JF
Language: English
References: 38
Page: 514-518
PDF size: 195.36 Kb.
ABSTRACT
Objective. To evaluate the inter-rater reliability of a data
collection instrument to assess the tobacco retail environment
in Mexico, after major marketing regulations were
implemented.
Materials and methods. In 2013, two data
collectors independently evaluated 21 stores in two census
tracts, through a data collection instrument that assessed
the presence of price promotions, whether single cigarettes
were sold, the number of visible advertisements, the presence
of signage prohibiting the sale of cigarettes to minors,
and characteristics of cigarette pack displays. We evaluated
the inter-rater reliability of the collected data, through the
calculation of metrics such as intraclass correlation coefficient,
percent agreement, Cohen’s kappa and Krippendorff’s
alpha.
Results. Most measures demonstrated substantial
or perfect inter-rater reliability.
Conclusions. Our results
indicate the potential utility of the data collection instrument
for future point-of-sale research.
REFERENCES
Henriksen L. Comprehensive tobacco marketing restrictions: promotion, packaging, price and place. Tob Control 2012;21(2):147-153.
Paynter J, Edwards R. The impact of tobacco promotion at the point of sale: a systematic review. Nicotine Tob Res 2009;11(1):25-35.
Robertson L, McGee R, Marsh L, Hoek J. A Systematic Review on the Impact of Point-of-Sale Tobacco Promotion on Smoking. Nicotine Tob Res 2015;17(1):2-17. PubMed PMD: 25173775. Epub 2014/09/01.
World Health Organization. Framework Convention on Tobacco Control 2013 [cited 2013 April 20]. Available from: http://www.who.int/fctc/en/.
Global Adult Tobacco Survey. Mexico country report. Washington, DC: World Health Organization, 2009.
Hernández-Ávila JE, Tirado-Ramírez E, Santos-Luna R, Reynales- Shigematsu LM. Use of Geographical Information Systems for billboards and points-of-sale surveillance in two Mexico cities. Salud Publica Mex 2007;49:s241-s246.
Ley general para el control de tabaco, México: Diario Oficial de la Federación 06-01-2010, 2008.
Hall MG, Fleischer NL, Reynales-Shigematsu LM, Arillo-Santillan E, Thrasher JF. Increasing availability and consumption of single cigarettes: trends and implications for smoking cessation from the ITC Mexico Survey. Tob Control 2015;24 Suppl 3:iii64-iii70. PubMed 25192772. Pubmed Central PMCID: PMC 4465400. Epub 2014/09/07.
Perez-Hernandez R, Thrasher JF, Rodriguez-Bolanos R, Barrientos-Gutierrez I, Ibanez-Hernandez NA.Autorreporte de exposicion a publicidad y promocion de tabaco en una cohorte de fumadores mexicanos. Salud Publica Mex 2012;54(3):204-212.
Lee JG, Henriksen L, Myers AE, Dauphinee AL, Ribisl KM. A systematic review of store audit methods for assessing tobacco marketing and products at the point of sale. Tob Control 2014;23(2):98-106.
Shareck M, Dassa C, Frohlich KL. Improving the measurement of neighbourhood characteristics through systematic observation: inequalities in smoking as a case study. Health place 2012;18(3):671-682.
Seidenberg AB, Caughey RW, Rees VW, Connolly GN. Storefront cigarette advertising differs by community demographic profile. Am J Health Promot 2010 24(6):e26-31.
Bernstein SL, Cabral L, Maantay J, Peprah D, Lounsbury D, Maroko A, et al. Disparities in access to over-the-counter nicotine replacement products in New York City pharmacies. Am J Public Health 2009;99(9):1699-1704.
Devlin E, Anderson S, Borland R, MacKintosh AM, Hastings G. Development of a research tool to monitor point of sale promotions. Social Marketing Quarterly 2006;12(1):29-39.
Feighery EC, Ribisl KM, Schleicher N, Lee RE, Halvorson S. Cigarette advertising and promotional strategies in retail outlets: results of a statewide survey in California. Tob Control 2001;10(2):184-188.
Henriksen L, Feighery EC, Schleicher NC, Haladjian HH, Fortmann SP. Reaching youth at the point of sale: cigarette marketing is more prevalent in stores where adolescents shop frequently. Tob Control 2004;13(3):315-318.
Wakefield MA, Terry-McElrath YM, Chaloupka FJ, Barker DC, Slater SJ, Clark PI, et al. Tobacco industry marketing at point of purchase after the 1998 MSA billboard advertising ban. Am J Public Health 2002;92(6):937-940.
Hosler AS, Dharssi A. Reliability of a survey tool for measuring consumer nutrition environment in urban food stores. J Public Health Manag Pract 2011;17(5):E1-8.
Hosler AS, Kammer JR. Point-of-purchase tobacco access and advertisement in food stores. Tob Control 2012;21(4):451-452.
Jason LA, Pokorny SB, Mikulski K, Schoeny ME. Assessing storefront tobacco advertising after the billboard ban. Eval Health Prof 2004;27(1):22-33.
Quedley M, Ng B, Sapre N, Blakiston M, Crawford A, Devadas R, et al. In sight, in mind: retailer compliance with legislation on limiting retail tobacco displays. Nicotine Tob Res 2008;10(8):1347-1354.
Thrasher JF, Villalobos V, Barnoya J, Sansores R, O’Connor R. Consumption of single cigarettes and quitting behavior: a longitudinal analysis of Mexican smokers. BMC Public Health 2011;11:134.
Thrasher JF, Villalobos V, Dorantes-Alonso A, Arillo-Santillan E, Cummings KM, O’Connor R, et al. Does the availability of single cigarettes promote or inhibit cigarette consumption? Perceptions, prevalence and correlates of single cigarette use among adult Mexican smokers. Tob Control 2009;18(6):431-437.
Rodríguez-Bolaños R, Reynales-Shigematsu LM, Ibañez-Hernández NA, Santos-Luna R, Valdés-Salgado R, Ávila-Tang E, et al. Estrategia de vigilancia para el control del tabaco en México: publicidad, promoción y patrocinio, empaque y etiquetado. Salud Publica Mex 2010;52:S254-S266.
Tobacco Control Tracking Tools. Baltimore (MD): Johns Hopkins Bloomberg School of Public Health, 2005.
Johns Hopkins Bloomberg School of Public Health, International Union Against Tuberculosis and Lung Disease, Campaign for Tobacco-Free Kids. Assessing Compliance with Tobacco Advertising, Promotion, and Sponsorship (TAPS) Bans. Baltimore(MD): Johns Hopkins Bloomberg School of Public Health, 2013.
Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull 1979;86(2):420.
Fleiss JL, Cohen J. The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability. Educ Psychol Meas 1973;33:613-619.
Hallgren KA. Computing inter-rater reliability for observational data: An overview and tutorial. Tutorials in quantitative methods for psychology. 2012;8(1):23.
Cohen J. Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit. Psychol Bull 1968;70(4):213.
Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas 1960;20(1):37-46.
Hayes AF, Krippendorff K. Answering the call for a standard reliability measure for coding data. Commun Methods Meas 2007;1(1):77-89.
Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977:159-74.
Spanopoulos D, Britton J, McNeill A, Ratschen E, Szatkowski L. Tobacco display and brand communication at the point of sale: implications for adolescent smoking behaviour. Tob Control 2014;23(1):64-69.
Scheffels J, Lavik R. Out of sight, out of mind? Removal of point-ofsale tobacco displays in Norway. Tob Control 2013;22(e1):e37-42.
Paynter J, Edwards R, Schluter PJ, McDuff I. Point of sale tobacco displays and smoking among 14-15 year olds in New Zealand: a crosssectional study. Tob Control 2009;18(4):268-274.
Li L, Borland R, Fong GT, Thrasher JF, Hammond D, Cummings KM. Impact of point-of-sale tobacco display bans: findings from the International Tobacco Control Four Country Survey. Health Educ Res 2013;28(5):898-910.
Hoek J, Gifford H, Pirikahu G, Thomson G, Edwards R. How do tobacco retail displays affect cessation attempts? Findings from a qualitative study. Tob Control 2010;19(4):334-337.