IDEAS home Printed from https://ideas.repec.org/a/spr/psycho/v89y2024i3d10.1007_s11336-024-09976-3.html
   My bibliography  Save this article

The Crosswise Model for Surveys on Sensitive Topics: A General Framework for Item Selection and Statistical Analysis

Author

Listed:
  • Marco Gregori

    (Warwick Business School, University of Warwick)

  • Martijn G. Jong

    (Erasmus University Rotterdam)

  • Rik Pieters

    (Tilburg University)

Abstract

When surveys contain direct questions about sensitive topics, participants may not provide their true answers. Indirect question techniques incentivize truthful answers by concealing participants’ responses in various ways. The Crosswise Model aims to do this by pairing a sensitive target item with a non-sensitive baseline item, and only asking participants to indicate whether their responses to the two items are the same or different. Selection of the baseline item is crucial to guarantee participants’ perceived and actual privacy and to enable reliable estimates of the sensitive trait. This research makes the following contributions. First, it describes an integrated methodology to select the baseline item, based on conceptual and statistical considerations. The resulting methodology distinguishes four statistical models. Second, it proposes novel Bayesian estimation methods to implement these models. Third, it shows that the new models introduced here improve efficiency over common applications of the Crosswise Model and may relax the required statistical assumptions. These three contributions facilitate applying the methodology in a variety of settings. An empirical application on attitudes toward LGBT issues shows the potential of the Crosswise Model. An interactive app, Python and MATLAB codes support broader adoption of the model.

Suggested Citation

  • Marco Gregori & Martijn G. Jong & Rik Pieters, 2024. "The Crosswise Model for Surveys on Sensitive Topics: A General Framework for Item Selection and Statistical Analysis," Psychometrika, Springer;The Psychometric Society, vol. 89(3), pages 1007-1033, September.
  • Handle: RePEc:spr:psycho:v:89:y:2024:i:3:d:10.1007_s11336-024-09976-3
    DOI: 10.1007/s11336-024-09976-3
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11336-024-09976-3
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11336-024-09976-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Marc Höglinger & Ben Jann, 2018. "More is not always better: An experimental individual-level validation of the randomized response technique and the crosswise model," PLOS ONE, Public Library of Science, vol. 13(8), pages 1-22, August.
    2. Blair, Graeme & Coppock, Alexander & Moor, Margaret, 2020. "When to Worry about Sensitivity Bias: A Social Reference Theory and Evidence from 30 Years of List Experiments," American Political Science Review, Cambridge University Press, vol. 114(4), pages 1297-1315, November.
    3. Chuang, Erica & Dupas, Pascaline & Huillery, Elise & Seban, Juliette, 2021. "Sex, lies, and measurement: Consistency tests for indirect response survey methods," Journal of Development Economics, Elsevier, vol. 148(C).
    4. Samuel S. K. Kwan & Mike K. P. So & Kar Yan Tam, 2010. "Research Note ---Applying the Randomized Response Technique to Elicit Truthful Responses to Sensitive Questions in IS Research: The Case of Software Piracy Behavior," Information Systems Research, INFORMS, vol. 21(4), pages 941-959, December.
    5. Jouni Kuha & Jonathan Jackson, 2014. "The item count method for sensitive survey questions: modelling criminal behaviour," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 63(2), pages 321-341, February.
    6. Jun-Wu Yu & Guo-Liang Tian & Man-Lai Tang, 2008. "Two new models for survey sampling with sensitive characteristic: design and analysis," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 67(3), pages 251-263, April.
    7. Blair, Graeme & Imai, Kosuke, 2012. "Statistical Analysis of List Experiments," Political Analysis, Cambridge University Press, vol. 20(1), pages 47-77, January.
    8. Johannes Landsheer & Peter Van Der Heijden & Ger Van Gils, 1999. "Trust and Understanding, Two Psychological Aspects of Randomized Response," Quality & Quantity: International Journal of Methodology, Springer, vol. 33(1), pages 1-12, February.
    9. Graeme Blair & Kosuke Imai & Yang-Yang Zhou, 2015. "Design and Analysis of the Randomized Response Technique," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(511), pages 1304-1319, September.
    10. Shi-Fang Qiu & Man-Lai Tang & Ji-Ran Tao & Ricky S. Wong, 2022. "Sample Size Determination for Interval Estimation of the Prevalence of a Sensitive Attribute Under Randomized Response Models," Psychometrika, Springer;The Psychometric Society, vol. 87(4), pages 1361-1389, December.
    11. David J. Spiegelhalter & Nicola G. Best & Bradley P. Carlin & Angelika Van Der Linde, 2002. "Bayesian measures of model complexity and fit," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(4), pages 583-639, October.
    12. Imai, Kosuke & Park, Bethany & Greene, Kenneth F., 2015. "Using the Predicted Responses from List Experiments as Explanatory Variables in Regression Models," Political Analysis, Cambridge University Press, vol. 23(2), pages 180-196, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Burgstaller, Lilith & Feld, Lars P. & Pfeil, Katharina, 2022. "Working in the shadow: Survey techniques for measuring and explaining undeclared work," Journal of Economic Behavior & Organization, Elsevier, vol. 200(C), pages 661-671.
    2. Ivar Krumpal & Thomas Voss, 2020. "Sensitive Questions and Trust: Explaining Respondents’ Behavior in Randomized Response Surveys," SAGE Open, , vol. 10(3), pages 21582440209, July.
    3. Ó Ceallaigh, Diarmaid & Timmons, Shane & Robertson, Deirdre & Lunn, Pete, 2023. "Problem gambling: A narrative review of important policy-relevant issues," Research Series, Economic and Social Research Institute (ESRI), number SUSTAT119.
    4. Pier Francesco Perri & Eleni Manoli & Tasos C. Christofides, 2023. "Assessing the effectiveness of indirect questioning techniques by detecting liars," Statistical Papers, Springer, vol. 64(5), pages 1483-1506, October.
    5. Chuang, Erica & Dupas, Pascaline & Huillery, Elise & Seban, Juliette, 2021. "Sex, lies, and measurement: Consistency tests for indirect response survey methods," Journal of Development Economics, Elsevier, vol. 148(C).
    6. Olivia Bertelli & Thomas Calvo & Emmanuelle Lavallée & Marion Mercier & Sandrine Mesplé-Somps, 2023. "Measuring insecurity-related experiences and preferences in a fragile State. A list experiment in Mali," Working Papers DT/2023/01, DIAL (Développement, Institutions et Mondialisation).
    7. David Boto‐García & Federico Perali, 2024. "The association between marital locus of control and break‐up intentions," American Journal of Economics and Sociology, Wiley Blackwell, vol. 83(1), pages 35-57, January.
    8. Truong-Nhat Le & Shen-Ming Lee & Phuoc-Loc Tran & Chin-Shang Li, 2023. "Randomized Response Techniques: A Systematic Review from the Pioneering Work of Warner (1965) to the Present," Mathematics, MDPI, vol. 11(7), pages 1-26, April.
    9. Bertelli, Olivia & Calvo, Thomas & Lavallée, Emmanuelle & Mercier, Marion & Mesplé-Somps, Sandrine, 2024. "What one thinks, what one says and what one does: male justifications and practices of gender-based violence in Mali," CEPREMAP Working Papers (Docweb) 2406, CEPREMAP.
    10. Groenitz, Heiko, 2016. "A covariate nonrandomized response model for multicategorical sensitive variables," Computational Statistics & Data Analysis, Elsevier, vol. 103(C), pages 124-138.
    11. Andreas Lagerås & Mathias Lindholm, 2020. "How to ask sensitive multiple‐choice questions," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 47(2), pages 397-424, June.
    12. Shen‐Ming Lee & Truong‐Nhat Le & Phuoc‐Loc Tran & Chin‐Shang Li, 2022. "Investigating the association of a sensitive attribute with a random variable using the Christofides generalised randomised response design and Bayesian methods," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 71(5), pages 1471-1502, November.
    13. S. Rinken & S. Pasadas-del-Amo & M. Rueda & B. Cobo, 2021. "No magic bullet: estimating anti-immigrant sentiment and social desirability bias with the item-count technique," Quality & Quantity: International Journal of Methodology, Springer, vol. 55(6), pages 2139-2159, December.
    14. Marc Höglinger & Ben Jann, 2018. "More is not always better: An experimental individual-level validation of the randomized response technique and the crosswise model," PLOS ONE, Public Library of Science, vol. 13(8), pages 1-22, August.
    15. Shen-Ming Lee & Phuoc-Loc Tran & Truong-Nhat Le & Chin-Shang Li, 2023. "Prediction of a Sensitive Feature under Indirect Questioning via Warner’s Randomized Response Technique and Latent Class Model," Mathematics, MDPI, vol. 11(2), pages 1-21, January.
    16. Carole Treibich & Aurélia Lépine, 2019. "Estimating misreporting in condom use and its determinants among sex workers: Evidence from the list randomisation method," Health Economics, John Wiley & Sons, Ltd., vol. 28(1), pages 144-160, January.
    17. Julia Meisters & Adrian Hoffmann & Jochen Musch, 2020. "Can detailed instructions and comprehension checks increase the validity of crosswise model estimates?," PLOS ONE, Public Library of Science, vol. 15(6), pages 1-19, June.
    18. María del Mar García Rueda & Pier Francesco Perri & Beatriz Rodríguez Cobo, 2018. "Advances in estimation by the item sum technique using auxiliary information in complex surveys," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 102(3), pages 455-478, July.
    19. Walzenbach, Sandra & Hinz, Thomas, 2022. "Puzzling Answers to Crosswise Questions - Examining Overall Prevalence Rates, Primacy Effects and Learning Effects," EconStor Preprints 249353, ZBW - Leibniz Information Centre for Economics.
    20. Henry Cust & Aurélia Lépine & Carole Treibich & Timothy Powell‐Jackson & Rosalba Radice & Cheikh Tidiane Ndour, 2024. "Trading HIV for sheep: Risky sexual behavior and the response of female sex workers to Tabaski in Senegal," Health Economics, John Wiley & Sons, Ltd., vol. 33(1), pages 153-193, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:psycho:v:89:y:2024:i:3:d:10.1007_s11336-024-09976-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.