Efectos de respuesta en cuestionarios con preguntas de actitud
Resumen
Existe un gran acuerdo según el cual el orden de presentación de las categorías de respuesta influye en las respuestas de los entrevistados, aunque los resultados son diversos y no muy concluyentes. Esta investigación busca contribuir a esta área de trabajo utilizando una investigación telefónica con un cuestionario con respuestas administradas en orden diferente y preguntas descompuestasen dos partes.Los resultados desvelan que la encuesta telefónica presenta efectos de primacía y de recencia. Los primeros afectan a las dos primeras categorías, y los segundos, únicamente a la penúltima categoría de respuesta. Los efectos de primacía son mayores cuando las categorías se muestran en orden inverso y en un formato de administración en dos preguntas. Los efectos de recencia, por su parte, en la penúltima categoría, son más frecuentes en el orden favorable y en el formato convencional.
Palabras clave
primacía, recencia, efectos de respuesta, efecto satisficingCitas
Azofra, María José (1999). Cuestionarios. Colección «Cuadernos Metodológicos», 26. Madrid: Centro de Investigaciones Sociológicas.
Bishop, George; Smith, Andrew (1997). Response-order effects in public opinion surveys: The plausibility of rival hypotheses. Presentado en la conferencia anual de la American Association for Public Opinion Research, Norfolk, VA.
Bishop, George; Smith, Andrew (2001). «Response-Order Effects and the Early Gallup Split-Ballots». Public Opinion Quarterly, 65, 479-505. https://doi.org/10.1086/323575 .
Cannel, Charles (1992). Characteristics of questions that cause problems for interviewer and respondents. Ann Arbor: Survey Research Center.
Cantril, Hadley (1944). Gauging Public Opinion. Princeton: Princeton University Press.
Chang, Linchat; Krosnick, Jon A. (2010). «Comparing oral interviewing with self-administered computerized questionnaires: An experiment». Public Opinion Quarterly, 74, 154-167. https://doi.org/10.1093/poq/nfp090 .
Christian, Leah Melani; Dillman, Don A.; Smyth, Jolene D. (2007). «Helping Respondents Get it Right the First Time: The Relative Influence of Words, Symbols, and Graphics in Web and Telephone Surveys». Public Opinion Quarterly, 71 (1), 113-125. https://doi.org/10.1093/poq/nfl039 .
Christian, Leah Melani; Dillman, Don A.; Smyth, Jolene D. (2008). «The Effects of Mode and Format on Answers to Scalar Questions in Telephone and Web Surveys». En: Lepkowski, James; et al. (eds.). Advances in Telephone Survey Methodology. Nueva York: Wiley-Interscience.
Christian, Leah Melani; Smyth, Jolene D. (2008). «Visual Communication». En: Lavrakas, P. (ed.). Encyclopedia of Survey Research Methods. California: Sage Publications, Inc.
Conrad, Frederick (2019). «Race of Virtual Interviewer Effects». Interviewers and their effects from a total survey error perspective. International Worshop celebrado en la Universidad de Nebraska-Lincoln, 26-28 de febrero.
Díaz de Rada, Vidal (2011). «Utilización conjunta de encuesta presencial y telefónica en encuestas electorales». Revista Internacional de Sociología, 69, 393-416.
https://doi.org/10.3989/ris.2009.01.10 .
Díaz de Rada, Vidal; Ayerdi, Peio (2007). «Algunos problemas de la encuesta telefónica para la proyección electoral». Revista Española de Investigaciones Sociológicas, 118, 153-204.
Díaz de Rada, Vidal; Portilla, Idoia (2015). «Encuestas telefónicas: estrategias para mejorar la colaboración». Perspectiva Empresarial, 2 (1), 97-115. https://doi.org/10.16967/rpe.47 .
Dillman, Don A. (1978). Mail and Telephone Surveys. Nueva York: Wiley.
Dillman, Don A.; Gertseva, Arina; Mahon-Haft, Taj (2005). «Achieving usability in establishment surveys through the application of visual design principles». Journal of Official Statistics, 21 (2), 183-214.
Dillman, Don A.; Smyth, Jolene D. (2007). «Design Effects in the Transition from Telephone to Web-Based Surveys». American Journal of Preventive Medicine, 32 (5S), S90-S96. https://doi.org/10.1016/j.amepre.2007.03.008 .
Dillman, Don A.; Smyth, Jolene D.; Christian, Leah Melanie (2014). Internet, Mail and Mixed-Mode Surveys: The Tailored Design Method. 4ª edición. Nueva York: John Wiley.
Ellis, Charles H.; Krosnick, Jon (1999). Comparing telephone and face to face surveys in terms of sample representativeness: A Meta-Analysis of Demographics Characteristics. Ann Arbor: Universidad de Michigan, NES.
Fowler, Floyd J. (1995). Improving Survey Questions. Londres: Sage.
Fowler, Floyd J. (2011). «Coding the behavior of interviewers and respondents to evaluate survey questions». En: Madans, Jennifer; Miller, Kristen; Maitland, Aaron; Willis, Gordon (2011). Question Evaluation Methods: Contributing to the Science of Data Quality, 7-22. Nueva York: Wiley.
Frey, James H. (1989). Survey Research by Telephone. Londres: Sage.
Galesic, Mirta; Tourangeau, Robert; Couper, Mick P.; Conrad, Frederick (2008). «Eye-tracking data: New Insights on Response Order Effects and Other Cognitive Shortcuts in Survey Responding». Public Opinion Quarterly, 72 (5), 892-913. https://doi.org/10.1093/poq/nfn059 .
García Ferrando, Manuel; Llopis, Ramón (2015). «La encuesta». En: García Ferrando, Manuel; et al. (comps.). El análisis de la realidad social. Madrid: Alianza.
Gilbert, Emily E. (2015). «A comparison of branched versus unbranched rating scales for the measurement of attitudes in surveys». Public Opinion Quarterly, 79, 443-470. https://doi.org/10.1093/poq/nfu090 .
Groves, Robert M. (2012). «Three Eras of Survey Research». Public Opinion Quarterly, 76, 861-871. https://doi.org/10.1093/poq/nfr057 .
Groves, Robert M.; Kahn, Louis (1979). Surveys by telephone: a national comparison with personal interviews. Orlando: Academic Press.
Gwartney, Patricia A. (2007). The Telephone Interviewer’s Handbook: How to conduct standardized conversations. San Francisco: Jossey-Bass.
Häder, Sabine; Häder, Michael; Kühne, Mike (2012). «Introduction: telephone surveys in Europe». En: Häder, Sabine; Häder, Michael; Kühne, Mike (eds.). Telephone Surveys in Europe: Research and Practice. Manheim: Springer Verlag.
Holbrook, Allyson L.; Green, Melanie C.; Krosnick, Jon A. (2003). «Telephone versus face-to-face interviewing of national probability samples with long questionnaires». Public Opinion Quarterly, 67, 79-125. https://doi.org/10.1086/346010 .
Holbrook, Alyson L.; Krosnick, Jon A.; Moore, David; Tourangeau, Robert (2007). «Response order effects in dichotomous categorical questions presented orally: the impact of question and respondent attributes». Public Opinion Quarterly, 71, 325-348. https://doi.org/10.1093/poq/nfm024 .
Johnson, Timothy P.; Holbrook, Allyson; Cho, Young Ik; Shavitt, Sharon; Chavez, Noel; Weiner, Saur (2019). «Examining the Comparability of Behavior Coding Across Cultures». En: Johnson, Timothy P.; Pennel, Beth-Ellen; Stoop, Ineke; Dorer, Brita, (eds), Advances in Comparative Survey Methods: Multinational, Multiregional, and Multicultural Contexts (3MC). Hoboken, N.J.: Wiley.
Krosnick, Jon A. (1991). «Response Strategies for Coping with the Cognitive Demands of Attitude Measures in Surveys». Applied Cognitive Psychology, 5, 213-236. https://doi.org/10.1146/annurev.psych.50.1.537 .
Krosnick, Jon A. (1999). «Survey research». Annual Review of Psychology, 50, 537-567. https://doi.org/10.1146/annurev.psych.50.1.537 .
Krosnick, Jon A.; Alwin, Duane F. (1987). «An evaluation of a cognitive theory of response-order effects in survey measurement». Public Opinion Quarterly, 51, 201-219. https://doi.org/10.1086/269029 .
Krosnick, Jon A.; Berent, Katthew M. (1993). «Comparison of party identification and policy preferences: the impact of survey question format». American Journal of Political Science, 37, 941-964. https://doi.org/10.2307/2111580 .
Krosnick, Jon A.; Narayan, Sowmya; Smith, Wendy R. (1996). «Satisficing in Surveys: Initial Evidence». New Directions for Evaluation, 70, 29-44. https://doi.org/10.1002/ev.1033 .
Krosnick, Jon A.; Holbrook, Allyson L.; Berent, Matthew K.; et al. (2002). «The Impact of “No Opinion” Response Options on Data Quality: Non-Attitude Reduction or an Invitation to Satisfice?». Public Opinion Quarterly, 66, 371-403. https://doi.org/10.1086/341394 .
Krosnick, Jon A.; Presser, Stanley (2010). «Question and questionnaire design». En: Marsden, Peter; Wright, J. (eds.). Handbook of Survey Research. Bingley: Emerald Group Publishing Limited.
Lavrakas, Paul J. (1993). Telephone Survey Methods. Newbury Park-California: Sage.
Lavrakas, Paul J. (2008). «Surveys by telephone». En: Donsbach, Wolfang; Traugott, Michael (eds.). The SAGE Handbook of Public Opinion Research. Thousand-Oaks: Sage.
Lavrakas, Paul J. (2010). «Telephone survey». En: Marsden, Peter V.; Wright, James D. (eds.). Handbook of Survey Research. Bingley: Emerald Group Publishing Limited.
Leeuw, Edith de (2008). «Choosing the method of data collection». En: Leeuw, Edith de; Hox, Jon J.; Dillman, Don A. (eds.). International Handbook of Survey Methodology. Nueva York: Lawrence Erlbaum Associates and European Association of Methodology.
Leeuw, Edith de; Hox, Joop J. (2015). «Survey mode and mode effects». En: Engel, Uwe; et al. (eds.). Improving survey methods. Lessons from recent research. Nueva York y Londres: Routledge and European Association of Methodology.
Lundmark, Sebastian; Gilljam, Mikael; Dahlberg, Stefan (2016). «Measuring generalized trust: An examination of question wording and the number of scale points». Public Opinion Quarterly, 80 (1), 26-43. https://doi.org/10.1093/poq/nfv042 .
Malhotra, Neil; Krosnick, Jon A.; Thomas, Randall, K. (2009). «Optimal design of branching questions to measure bipolar construct». Public Opinion Quarterly, 73, 304-324. https://doi.org/10.1093/poq/nfp023 .
Martínez de Luna, Iñaki (2008). «Encuestas de opinión: de la teoría a la práctica». Metodología de Encuestas, 10, 7-26.
Maynard, Douglas W.; Shaeffer, Nora Cate (2006). «Standardization in Interaction: The Survey Interview». En: Drew, Paul; Raymond, Geoff; Weinberg, Darin (eds.). Talking Research. Londres: Sage.
Nicolaas, G.; Thomson, K.; Lynn, P. (2000). The feasibility of conducing Electoral Surveys in the UK by telephone. Londres: National Centre for Social Research.
Olson, Kristen; Smyth, Jolene D. (2015). «The Effect of CATI Questions, Respondents, and Interviewers on Response Time». Journal of Survey Statistics and Methodology, 3 (3), 361-396.
https://doi.org/10.1093/jssam/smv006
Park, Hyunjoo; Lee, Jaehwan (2018): «Exploring the Validity of Behavior Coding». Field Methods, 30 (3), 225-240. https://doi.org/10.1177/1525822X18781881 .
Payne, Stanley L. (1951). The art of asking questions. Princeton: Princeton University Press.
Rossi, Peter H.; Wright, James D.; Anderson, Andy B. (1983). «Sample surveys: history, current practice and future prospects». En: Rossi, Peter H.; Wright, James D.; Anderson, Andy B. (eds.). Handbook of Survey Research. Nueva York: Academic Press.
Schwarz, Norbert (2008). «The psychology of survey response». En: Donsbach; Wolfang; Traugott, Michael W. (eds.). The SAGE Handbook of Public Opinion Research. Thousand-Oaks: Sage.
Schwarz, Norbert; Hippler, Hans J. (1987). «What response scale may tell your respondents: Information functions of response alternatives». En: Hippler, Hebert J.; Schwarz, Norbert; Sudman, Seymour (eds.). Social information processing and survey methodology. Nueva York: Springer-Verlag.
Simon, Hebert A. (1957). Models of Man. Nueva York: Wiley.
Singer, Eleanor (2016). «Reflections on Surveys’ Past and Future». Journal of Survey Statistics and Methodology, 4, 463-475. https://doi.org/10.1093/jssam/smw026 .
Smyth, Jolene D.; Dillman, Don A.; Christian, Leah Melani (2007). «Context Effects in Web Surveys: New Issues and Evidence». En: Joinson, Alain; McKenna, Katelyn; Postmes, Tom. Nueva York: Oxford University Press.
Stern, Michael J.; Smyth, Jolene D.; Mendez, J. (2012). «The Effects of Item Saliency and Question Design on Measurement Error in a Self-Administered Survey». Field Methods, 24, 3-27. https://doi.org/10.1177/1525822X11419478 .
Tourangeau, Roger; Rasinski, Kennet (1988). «Cognitive Processes Underlying Context Effects in Attitude Measurement». Psychological Bulletin, 103, 299-314. http://dx.doi.org/10.1037/0033-2909.103.3.299 .
Tourangeau, Roger; Couper, Mick P.; Conrad, Frederick (2004). «Spacing, Position, and Order: Interpretive heuristics for visual features of survey questions». Public Opinion Quarterly, 68, 368-393. https://doi.org/10.1093/poq/nfh035 .
Tourangeau, Roger; Couper, Mick P.; Conrad, Frederick (2013a). «Up Means Good»: The Effect of Screen Position on Evaluative Ratings in Web Surveys». Public Opinion Quarterly, 77, 69-88. https://doi.org/10.1093/poq/nfh035 .
Tourangeau, Roger; Couper, Mick P.; Conrad, Frederick (2013b). The Science of Web Surveys. Nueva York: Oxford University Press.
Visauta, Restituto (1989). Técnicas de investigación social. Barcelona: PPU.
Wright, James D.; Mardsen, Peter V. (2010). «Survey research and social science: history, current practice and future prospects». En: Mardsen, Peter V.; Wright, James D. (eds.). Handbook of Survey Research. Bingley: Emerald Group Publishing Limited.
Ye, Cong; Fulton, Henna; Tourangeau, Roger (2011). «More positive o more extreme? A meta-analysis of mode difference in response choice». Public Opinion Quarterly, 75, 349-3.655. https://doi.org/10.1093/poq/nfr009 .
Zaller, John (2014). La naturaleza y los orígenes de la opinión pública. Madrid: Centro de Investigaciones Sociológicas.
Zhang, Chan (2013). «Design of Interactive Interventions in Web Surveys: Humanness, Social Presence, and Data Quality». Satisficing in Web Surveys: Implications for Data Quality and Strategies for Reduction. Doctor of Philosophy (Survey Methodology), 60-96.
Zouden, J. van der; Smith, J. H. (2004). «Evaluating survey questions by analyzing patterns of behavior codes and question-answer sequences: A diagnostic approach». En: Presser, S.; Rothgeb, J.; Couper, M.; Lessler, J.; Martin, E.; Martin, J.; Singer, E. (eds.). Questionnaire Development Evaluation and Testing Methods, 109-130. Nueva York: Wiley.
Publicado
Descargas
Derechos de autor 2020 Vidal Díaz de Rada
Esta obra está bajo una licencia internacional Creative Commons Atribución-NoComercial 4.0.
