IDEAS home Printed from https://ideas.repec.org/a/eee/ecolet/v238y2024ics0165176524001691.html
   My bibliography  Save this article

What I say depends on how you ask: Experimental evidence of the effect of framing on the measurement of attitudes

Author

Listed:
  • Bloem, Jeffrey R.
  • Rahman, Khandker Wahedur

Abstract

We use a survey experiment to document the presence of framing effects in the measurement of attitudes. Next, using standard techniques for generating aggregate indices, we find that statement framing can meaningfully influence the relationship of the index with relevant covariates—in some cases changing the magnitude, statistical significance, and even the sign of the estimated relationship. We conclude by discussing how randomizing statement framing across respondents can help address bias in the measurement of attitudes.

Suggested Citation

  • Bloem, Jeffrey R. & Rahman, Khandker Wahedur, 2024. "What I say depends on how you ask: Experimental evidence of the effect of framing on the measurement of attitudes," Economics Letters, Elsevier, vol. 238(C).
    • Handle: RePEc:eee:ecolet:v:238:y:2024:i:c:s0165176524001691
    DOI: 10.1016/j.econlet.2024.111686
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0165176524001691
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.econlet.2024.111686?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Tamer, Elie, 2010. "Partial Identification in Econometrics," Scholarly Articles 34728615, Harvard University Department of Economics.
    2. Alberto Abadie & Susan Athey & Guido W Imbens & Jeffrey M Wooldridge, 2023. "When Should You Adjust Standard Errors for Clustering?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 138(1), pages 1-35.
    3. Molinari, Francesca, 2020. "Microeconometrics with partial identification," Handbook of Econometrics, in: Steven N. Durlauf & Lars Peter Hansen & James J. Heckman & Rosa L. Matzkin (ed.), Handbook of Econometrics, edition 1, volume 7, chapter 0, pages 355-486, Elsevier.
    4. Francesca Molinari, 2020. "Microeconometrics with Partial Identification," Papers 2004.11751, arXiv.org.
    5. Jeffrey R Kling & Jeffrey B Liebman & Lawrence F Katz, 2007. "Experimental Analysis of Neighborhood Effects," Econometrica, Econometric Society, vol. 75(1), pages 83-119, January.
    6. Elie Tamer, 2010. "Partial Identification in Econometrics," Annual Review of Economics, Annual Reviews, vol. 2(1), pages 167-195, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chalak, Karim, 2024. "Nonparametric Gini-Frisch bounds," Journal of Econometrics, Elsevier, vol. 238(1).
    2. Wenlong Ji & Lihua Lei & Asher Spector, 2023. "Model-Agnostic Covariate-Assisted Inference on Partially Identified Causal Effects," Papers 2310.08115, arXiv.org, revised Nov 2024.
    3. Daniel Kaliski, 2023. "Identifying the impact of health insurance on subgroups with changing rates of diagnosis," Health Economics, John Wiley & Sons, Ltd., vol. 32(9), pages 2098-2112, September.
    4. Sarah Moon, 2024. "Partial Identification of Individual-Level Parameters Using Aggregate Data in a Nonparametric Model," Papers 2403.07236, arXiv.org, revised May 2024.
    5. Schuessler, Julian, 2024. "Causal analysis with observational data," OSF Preprints wam94, Center for Open Science.
    6. Manski, Charles F. & Molinari, Francesca, 2021. "Estimating the COVID-19 infection rate: Anatomy of an inference problem," Journal of Econometrics, Elsevier, vol. 220(1), pages 181-192.
    7. Xiaoyu Cheng, 2022. "Robust Data-Driven Decisions Under Model Uncertainty," Papers 2205.04573, arXiv.org.
    8. Jorg Stoye, 2020. "A Simple, Short, but Never-Empty Confidence Interval for Partially Identified Parameters," Papers 2010.10484, arXiv.org, revised Dec 2020.
    9. Lina Zhang & David T. Frazier & D. S. Poskitt & Xueyan Zhao, 2020. "Decomposing Identification Gains and Evaluating Instrument Identification Power for Partially Identified Average Treatment Effects," Papers 2009.02642, arXiv.org, revised Sep 2022.
    10. Pietro Tebaldi & Alexander Torgovitsky & Hanbin Yang, 2023. "Nonparametric Estimates of Demand in the California Health Insurance Exchange," Econometrica, Econometric Society, vol. 91(1), pages 107-146, January.
    11. Ann Mitchell & Jimena Macció & Diego Mariño Fages, 2019. "The Effects of Emergency Housing on Wellbeing: Evidence from Argentina’s Informal Settlements," The European Journal of Development Research, Palgrave Macmillan;European Association of Development Research and Training Institutes (EADI), vol. 31(3), pages 504-529, July.
    12. Nathan Kallus, 2022. "What's the Harm? Sharp Bounds on the Fraction Negatively Affected by Treatment," Papers 2205.10327, arXiv.org, revised Nov 2022.
    13. Yiwei Sun, 2023. "Extrapolating Away from the Cutoff in Regression Discontinuity Designs," Papers 2311.18136, arXiv.org.
    14. Eric Auerbach & Yong Cai, 2023. "Identifying Socially Disruptive Policies," Papers 2306.15000, arXiv.org, revised Jun 2023.
    15. Sung Jae Jun & Sokbae Lee, 2024. "Causal Inference Under Outcome-Based Sampling with Monotonicity Assumptions," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 42(3), pages 998-1009, July.
    16. Ahsan, Md Nazmul & Maharaj, Riddhi, 2018. "Parental human capital and child health at birth in India," Economics & Human Biology, Elsevier, vol. 30(C), pages 130-149.
    17. Amin, Vikesh & Behrman, Jere R. & Fletcher, Jason M. & Flores, Carlos A. & Flores-Lagunes, Alfonso & Kohler, Hans-Peter, 2022. "Does Schooling Improve Cognitive Abilities at Older Ages: Causal Evidence from Nonparametric Bounds," IZA Discussion Papers 15371, Institute of Labor Economics (IZA).
    18. Millimet, Daniel L. & Roy, Jayjit, 2015. "Multilateral environmental agreements and the WTO," Economics Letters, Elsevier, vol. 134(C), pages 20-23.
    19. Breunig, Christoph & Mammen, Enno & Simoni, Anna, 2018. "Nonparametric estimation in case of endogenous selection," Journal of Econometrics, Elsevier, vol. 202(2), pages 268-285.
    20. Christian Bontemps & Raquel Menezes Bezerra Sampaio, 2020. "Entry games for the airline industry," Post-Print hal-02137358, HAL.

    More about this item

    Keywords

    Survey design; Attitudes; Response bias; Framing effects; Non-classical measurement error; Data collection;
    All these keywords.

    JEL classification:

    • C83 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Survey Methods; Sampling Methods
    • D91 - Microeconomics - - Micro-Based Behavioral Economics - - - Role and Effects of Psychological, Emotional, Social, and Cognitive Factors on Decision Making
    • G41 - Financial Economics - - Behavioral Finance - - - Role and Effects of Psychological, Emotional, Social, and Cognitive Factors on Decision Making in Financial Markets

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecolet:v:238:y:2024:i:c:s0165176524001691. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ecolet .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.