IDEAS home Printed from https://ideas.repec.org/a/spr/qualqt/v55y2021i6d10.1007_s11135-021-01098-7.html
   My bibliography  Save this article

No magic bullet: estimating anti-immigrant sentiment and social desirability bias with the item-count technique

Author

Listed:
  • S. Rinken

    (Institute for Advanced Social Studies/Spanish Research Council (IESA-CSIC))

  • S. Pasadas-del-Amo

    (Institute for Advanced Social Studies/Spanish Research Council (IESA-CSIC))

  • M. Rueda

    (University of Granada. Avda. Fuentenueva s/n)

  • B. Cobo

    (University of Granada. Avda. Fuentenueva s/n)

Abstract

Extant scholarship on attitudes toward immigration and immigrants relies mostly on direct survey items. Thus, little is known about the scope of social desirability bias, and even less about its covariates. In this paper, we use probability-based mixed-modes panel data collected in the Southern Spanish region of Andalusia to estimate anti-immigrant sentiment with both the item-count technique, also known as list experiment, and a direct question. Based on these measures, we gauge the size of social desirability bias, compute predictor models for both estimators of anti-immigrant sentiment, and pinpoint covariates of bias. For most respondent profiles, the item-count technique produces higher estimates of anti-immigrant sentiment than the direct question, suggesting that self-presentational concerns are far more ubiquitous than previously assumed. However, we also find evidence that among people keen to position themselves as all-out xenophiles, social desirability pressures persist in the list-experiment: the full scope of anti-immigrant sentiment remains elusive even in non-obtrusive measurement.

Suggested Citation

  • S. Rinken & S. Pasadas-del-Amo & M. Rueda & B. Cobo, 2021. "No magic bullet: estimating anti-immigrant sentiment and social desirability bias with the item-count technique," Quality & Quantity: International Journal of Methodology, Springer, vol. 55(6), pages 2139-2159, December.
  • Handle: RePEc:spr:qualqt:v:55:y:2021:i:6:d:10.1007_s11135-021-01098-7
    DOI: 10.1007/s11135-021-01098-7
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11135-021-01098-7
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11135-021-01098-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. L. J. Zigerell, 2011. "You Wouldn't Like Me When I'm Angry: List Experiment Misreporting," Social Science Quarterly, Southwestern Social Science Association, vol. 92(2), pages 552-562, June.
    2. Stephens-Davidowitz, Seth, 2014. "The cost of racial animus on a black candidate: Evidence using Google search data," Journal of Public Economics, Elsevier, vol. 118(C), pages 26-40.
    3. Ivar Krumpal, 2013. "Determinants of social desirability bias in sensitive surveys: a literature review," Quality & Quantity: International Journal of Methodology, Springer, vol. 47(4), pages 2025-2047, June.
    4. Imai, Kosuke, 2011. "Multivariate Regression Analysis for the Item Count Technique," Journal of the American Statistical Association, American Statistical Association, vol. 106(494), pages 407-416.
    5. Ahlquist, John S., 2018. "List Experiment Design, Non-Strategic Respondent Error, and Item Count Technique Estimators," Political Analysis, Cambridge University Press, vol. 26(1), pages 34-53, January.
    6. Corstange, Daniel, 2009. "Sensitive Questions, Truthful Answers? Modeling the List Experiment with LISTIT," Political Analysis, Cambridge University Press, vol. 17(1), pages 45-63, January.
    7. Gilens, Martin & Sniderman, Paul M. & Kuklinski, James H., 1998. "Affirmative Action and the Politics of Realignment," British Journal of Political Science, Cambridge University Press, vol. 28(1), pages 159-183, January.
    8. Neil Malhotra & Yotam Margalit & Cecilia Hyunjung Mo, 2013. "Economic Explanations for Opposition to Immigration: Distinguishing between Prevalence and Conditional Impact," American Journal of Political Science, John Wiley & Sons, vol. 57(2), pages 391-410, April.
    9. Sides, John & Citrin, Jack, 2007. "European Opinion About Immigration: The Role of Identities, Interests and Information," British Journal of Political Science, Cambridge University Press, vol. 37(3), pages 477-504, July.
    10. Francisco Herreros & Henar Criado, 2009. "Social Trust, Social Capital and Perceptions of Immigration," Political Studies, Political Studies Association, vol. 57(2), pages 337-355, June.
    11. Mathew J. Creighton & Amaney Jamal & Natalia C. Malancu, 2015. "Has Opposition to Immigration Increased in the United States after the Economic Crisis? An Experimental Approach," International Migration Review, Wiley Blackwell, vol. 49(3), pages 727-756, September.
    12. Marc Höglinger & Ben Jann, 2018. "More is not always better: An experimental individual-level validation of the randomized response technique and the crosswise model," PLOS ONE, Public Library of Science, vol. 13(8), pages 1-22, August.
    13. Gerber, Alan & Arceneaux, Kevin & Boudreau, Cheryl & Dowling, Conor & Hillygus, Sunshine & Palfrey, Thomas & Biggers, Daniel R. & Hendry, David J., 2014. "Reporting Guidelines for Experimental Research: A Report from the Experimental Research Section Standards Committee," Journal of Experimental Political Science, Cambridge University Press, vol. 1(1), pages 81-98, April.
    14. Lilli Japec & Frauke Kreuter & Marcus Berg & Paul Biemer & Paul Decker & Cliff Lampe & Julia Lane & Cathy O’Neil & Abe Usher, "undated". "Big Data in Survey Research: AAPOR Task Force Report," Mathematica Policy Research Reports c57e7c039f6a4db982b26c6fe, Mathematica Policy Research.
    15. Francisco Herreros & Henar Criado, 2009. "Social Trust, Social Capital and Perceptions of Immigration," Political Studies, Political Studies Association, vol. 57, pages 337-355, June.
    16. Mutz, Diana C. & Pemantle, Robin, 2015. "Standards for Experimental Research: Encouraging a Better Understanding of Experimental Methods," Journal of Experimental Political Science, Cambridge University Press, vol. 2(2), pages 192-215, January.
    17. Blair, Graeme & Imai, Kosuke, 2012. "Statistical Analysis of List Experiments," Political Analysis, Cambridge University Press, vol. 20(1), pages 47-77, January.
    18. Jennifer A. Heerwig & Brian J. McCabe, 2009. "Education and Social Desirability Bias: The Case of a Black Presidential Candidate," Social Science Quarterly, Southwestern Social Science Association, vol. 90(3), pages 674-686, September.
    19. Hainmueller, Jens & Hiscox, Michael J., 2007. "Educated Preferences: Explaining Attitudes Toward Immigration in Europe," International Organization, Cambridge University Press, vol. 61(2), pages 399-442, April.
    20. Alexander L. Janus, 2010. "The Influence of Social Desirability Pressures on Expressed Immigration Attitudes," Social Science Quarterly, Southwestern Social Science Association, vol. 91(4), pages 928-946, December.
    21. Bram Lancee & Sergi Pardos-Prado, 2013. "Group Conflict Theory in a Longitudinal Perspective: Analyzing the Dynamic Side of Ethnic Competition," International Migration Review, Wiley Blackwell, vol. 47(1), pages 106-131, March.
    22. Lynn, Peter & Jäckle, Annette & Hope, Steven & C. Campanelli, Pamela & Nicolaas, Gerry, 2012. "Effects of visual and aural communication of categorical response options on answers to survey questions," ISER Working Paper Series 2012-21, Institute for Social and Economic Research.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Fang, Tony & Xiao, Na & Zhu, Jane & Hartley, John, 2022. "Employer Attitudes and the Hiring of Immigrants and International Students: Evidence from a Survey of Employers in Canada," IZA Discussion Papers 15226, Institute of Labor Economics (IZA).
    2. Andreas Quatember, 2023. "Efficient item count techniques with one or two lists," METRON, Springer;Sapienza Università di Roma, vol. 81(1), pages 5-19, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. De Cao, Elisabetta & Lutz, Clemens, 2014. "Sensitive survey questions," Research Report 14017-EEF, University of Groningen, Research Institute SOM (Systems, Organisations and Management).
    2. Nicolò Conti & Danilo Di Mauro & Vincenzo Memoli, 2019. "Citizens, immigration and the EU as a shield," European Union Politics, , vol. 20(3), pages 492-510, September.
    3. repec:dgr:rugsom:14017-eef is not listed on IDEAS
    4. McGinnity, Frances & Creighton, Mathew & Fahey, Éamonn, 2020. "Hidden versus revealed attitudes: a list experiment on support for minorities in Ireland," Research Series, Economic and Social Research Institute (ESRI), number BKMNEXT372.
    5. Brownback, Andy & Novotny, Aaron, 2018. "Social desirability bias and polling errors in the 2016 presidential election," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 74(C), pages 38-56.
    6. Richard Traunmüller & Sara Kijewski & Markus Freitag, 2019. "The Silent Victims of Sexual Violence during War: Evidence from a List Experiment in Sri Lanka," Journal of Conflict Resolution, Peace Science Society (International), vol. 63(9), pages 2015-2042, October.
    7. Ahmad, Syedah & Lensink, Robert & Mueller, Annika, 2023. "Religion, social desirability bias and financial inclusion: Evidence from a list experiment on Islamic (micro-)finance," Journal of Behavioral and Experimental Finance, Elsevier, vol. 38(C).
    8. Tadesse, Getaw & Abate, Gashaw T. & Zewdie, Tadiwos, 2020. "Biases in self-reported food insecurity measurement: A list experiment approach," Food Policy, Elsevier, vol. 92(C).
    9. Yin Liu & Guo-Liang Tian & Qin Wu & Man-Lai Tang, 2019. "Poisson–Poisson item count techniques for surveys with sensitive discrete quantitative data," Statistical Papers, Springer, vol. 60(5), pages 1763-1791, October.
    10. Economidou, Claire & Karamanis, Dimitris & Kechrinioti, Alexandra & Xesfingi, Sofia, 2017. "What Shapes Europeans’ Attitudes toward Xeno-philia(/phobia)?," MPRA Paper 76511, University Library of Munich, Germany.
    11. Burgstaller, Lilith & Feld, Lars P. & Pfeil, Katharina, 2022. "Working in the shadow: Survey techniques for measuring and explaining undeclared work," Journal of Economic Behavior & Organization, Elsevier, vol. 200(C), pages 661-671.
    12. Frances McGinnity & Gillian Kingston, 2017. "An Irish Welcome? Changing Irish Attitudes to Immigrants and Immigration: The Role of Recession and Immigration," The Economic and Social Review, Economic and Social Studies, vol. 48(3), pages 253-279.
    13. Economidou Claire & Karamanis Dimitris & Kechrinioti Alexandra & Xesfingi Sofia, 2020. "The Role of Social Capital in Shaping Europeans’ Immigration Sentiments," IZA Journal of Development and Migration, Sciendo & Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 11(1), pages 1-31, January.
    14. Jouni Kuha & Jonathan Jackson, 2014. "The item count method for sensitive survey questions: modelling criminal behaviour," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 63(2), pages 321-341, February.
    15. Chuang, Erica & Dupas, Pascaline & Huillery, Elise & Seban, Juliette, 2021. "Sex, lies, and measurement: Consistency tests for indirect response survey methods," Journal of Development Economics, Elsevier, vol. 148(C).
    16. Yvonni Markaki & Simonetta Longhi, 2012. "What Determines Attitudes to Immigration in European Countries? An Analysis at the Regional Level," RF Berlin - CReAM Discussion Paper Series 1233, Rockwool Foundation Berlin (RF Berlin) - Centre for Research and Analysis of Migration (CReAM).
    17. Lépine, Aurélia & Treibich, Carole & D’Exelle, Ben, 2020. "Nothing but the truth: Consistency and efficiency of the list experiment method for the measurement of sensitive health behaviours," Social Science & Medicine, Elsevier, vol. 266(C).
    18. Leopoldo Fergusson & Carlos Molina & Juan Felipe Riaño, 2018. "I Sell My Vote, and So What? Incidence, Social Bias, and Correlates of Clientelism in Colombia," Economía Journal, The Latin American and Caribbean Economic Association - LACEA, vol. 0(Fall 2018), pages 181-218, November.
    19. Carole Treibich & Aurélia Lépine, 2019. "Estimating misreporting in condom use and its determinants among sex workers: Evidence from the list randomisation method," Health Economics, John Wiley & Sons, Ltd., vol. 28(1), pages 144-160, January.
    20. Louis Jaeck, 2022. "Political economy of immigration policy in GCC countries," Economics and Politics, Wiley Blackwell, vol. 34(3), pages 444-464, July.
    21. Jens Hainmueller & Daniel J. Hopkins, 2013. "Public Attitudes toward Immigration," RF Berlin - CReAM Discussion Paper Series 1315, Rockwool Foundation Berlin (RF Berlin) - Centre for Research and Analysis of Migration (CReAM).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:qualqt:v:55:y:2021:i:6:d:10.1007_s11135-021-01098-7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.