IDEAS home Printed from https://ideas.repec.org/p/ehl/lserod/88481.html
   My bibliography  Save this paper

The analysis of survey data with framing effects

Author

Listed:
  • Goldin, Jacob
  • Reck, Daniel

Abstract

A well-known difficulty in survey research is that respondents’ answers to questions can depend on arbitrary features of a survey’s design, such as the wording of questions or the ordering of answer choices. In this paper, we describe a novel set of tools for analyzing survey data characterized by such framing effects. We show that the conventional approach to analyzing data with framing effects—randomizing survey-takers across frames and pooling the responses—generally does not identify a useful parameter. In its place, we propose an alternative approach and provide conditions under which it identifies the responses that are unaffected by framing. We also present several results for shedding light on the population distribution of the individual characteristic the survey is designed to measure.

Suggested Citation

  • Goldin, Jacob & Reck, Daniel, 2018. "The analysis of survey data with framing effects," LSE Research Online Documents on Economics 88481, London School of Economics and Political Science, LSE Library.
    • Handle: RePEc:ehl:lserod:88481
    as

    Download full text from publisher

    File URL: http://eprints.lse.ac.uk/88481/
    File Function: Open access version.
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. repec:cup:judgdm:v:4:y:2009:i:7:p:554-566 is not listed on IDEAS
    2. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    3. Angus Deaton, 2012. "The financial crisis and the well-being of Americans," Oxford Economic Papers, Oxford University Press, vol. 64(1), pages 1-26, January.
    4. Abadie, Alberto, 2003. "Semiparametric instrumental variable estimation of treatment response models," Journal of Econometrics, Elsevier, vol. 113(2), pages 231-263, April.
    5. Charles F. Manski, 1989. "Anatomy of the Selection Problem," Journal of Human Resources, University of Wisconsin Press, vol. 24(3), pages 343-360.
    6. Lambdin, Charles & Shaffer, Victoria A., 2009. "Are within-subjects designs transparent?," Judgment and Decision Making, Cambridge University Press, vol. 4(7), pages 554-566, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Markus Frölich & Martin Huber, 2014. "Treatment Evaluation With Multiple Outcome Periods Under Endogeneity and Attrition," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(508), pages 1697-1711, December.
    2. Guilhem Bascle, 2008. "Controlling for endogeneity with instrumental variables in strategic management research," Post-Print hal-00576795, HAL.
    3. Pedro H. C. Sant'Anna & Xiaojun Song & Qi Xu, 2022. "Covariate distribution balance via propensity scores," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(6), pages 1093-1120, September.
    4. Manuel Arellano & Stéphane Bonhomme, 2017. "Quantile Selection Models With an Application to Understanding Changes in Wage Inequality," Econometrica, Econometric Society, vol. 85, pages 1-28, January.
    5. Guillermo Cruces & Sebastian Galiani, 2003. "Generalizing the Causal Effect of Fertility on Female Labor Supply," Labor and Demography 0310002, University Library of Munich, Germany.
    6. Ygué Patrice Adegbola1 & Baudelaire YF Kouton Bognon & Pélagie M Hessavi, 2020. "Economic Impact Assessment of Improved Maize Adoption on Poverty: Case Study of Four West African Countries," International Journal of Environmental Sciences & Natural Resources, Juniper Publishers Inc., vol. 26(4), pages 134-141, November.
    7. Joshua D. Angrist & Sarah R. Cohodes & Susan M. Dynarski & Parag A. Pathak & Christopher R. Walters, 2016. "Stand and Deliver: Effects of Boston's Charter High Schools on College Preparation, Entry, and Choice," Journal of Labor Economics, University of Chicago Press, vol. 34(2), pages 275-318.
    8. Alexandre Belloni & Victor Chernozhukov & Ivan Fernandez-Val & Christian Hansen, 2013. "Program evaluation with high-dimensional data," CeMMAP working papers CWP77/13, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    9. Huber Martin & Wüthrich Kaspar, 2019. "Local Average and Quantile Treatment Effects Under Endogeneity: A Review," Journal of Econometric Methods, De Gruyter, vol. 8(1), pages 1-27, January.
    10. Sloczynski, Tymon, 2018. "A General Weighted Average Representation of the Ordinary and Two-Stage Least Squares Estimands," IZA Discussion Papers 11866, Institute of Labor Economics (IZA).
    11. Altındağ, Onur & Bakış, Ozan & Rozo, Sandra V., 2020. "Blessing or burden? Impacts of refugees on businesses and the informal economy," Journal of Development Economics, Elsevier, vol. 146(C).
    12. Aassve, Arnstein & Arpino, Bruno, 2008. "Estimation of causal effects of fertility on economic wellbeing: evidence from rural Vietnam," ISER Working Paper Series 2007-27, Institute for Social and Economic Research.
    13. Jing You & Miguel Niño‐Zarazúa, 2019. "The Intergenerational Impact of China's New Rural Pension Scheme," Population and Development Review, The Population Council, Inc., vol. 45(S1), pages 47-95, December.
    14. Markus Frölich & Martin Huber, 2017. "Direct and indirect treatment effects–causal chains and mediation analysis with instrumental variables," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(5), pages 1645-1666, November.
    15. Hidalgo, Diana & Onofa, Mercedes & Oosterbeek, Hessel & Ponce, Juan, 2013. "Can provision of free school uniforms harm attendance? Evidence from Ecuador," Journal of Development Economics, Elsevier, vol. 103(C), pages 43-51.
    16. Guido W. Imbens, 2022. "Causality in Econometrics: Choice vs Chance," Econometrica, Econometric Society, vol. 90(6), pages 2541-2566, November.
    17. Pereda-Fernández, Santiago, 2023. "Identification and estimation of triangular models with a binary treatment," Journal of Econometrics, Elsevier, vol. 234(2), pages 585-623.
    18. Eva Deuchert & Martin Huber, 2017. "A Cautionary Tale About Control Variables in IV Estimation," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 79(3), pages 411-425, June.
    19. Markus Frölich, 2004. "Programme Evaluation with Multiple Treatments," Journal of Economic Surveys, Wiley Blackwell, vol. 18(2), pages 181-224, April.
    20. Yumou Qiu & Jing Tao & Xiao‐Hua Zhou, 2021. "Inference of heterogeneous treatment effects using observational data with high‐dimensional covariates," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 83(5), pages 1016-1043, November.

    More about this item

    Keywords

    Estimation; Inference; Psychology; Survey methodology;
    All these keywords.

    JEL classification:

    • J1 - Labor and Demographic Economics - - Demographic Economics

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ehl:lserod:88481. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: LSERO Manager (email available below). General contact details of provider: https://edirc.repec.org/data/lsepsuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.