IDEAS home Printed from https://ideas.repec.org/a/zbw/espost/167599.html
   My bibliography  Save this article

Using Person-Fit Measures to Assess the Impact of Panel Conditioning on Reliability

Author

Listed:
  • Kroh, Martin
  • Winter, Florin
  • Schupp, Jürgen

Abstract

Panel conditioning has posed one of the main challenges to panel studies since their inception in the social sciences. Aside from the risk of reactivity to previous interviews, there is reason to expect that cumulative survey experience increases the reliability of data emanating from panel studies relative to cross-sectional surveys. This positive aspect of recurrent interviewing for data quality has been given relatively little attention in the empirical research to date. Drawing on observational data from 30 waves of the German Socio-Economic Panel (SOEP), we study the effect of individual survey experience on reliability, focusing on person-fit statistics from item-response models. The analysis documents that four years of survey experience produce a higher increase in person reliability than tertiary education compared to primary education.

Suggested Citation

  • Kroh, Martin & Winter, Florin & Schupp, Jürgen, 2016. "Using Person-Fit Measures to Assess the Impact of Panel Conditioning on Reliability," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 80(4), pages 914-942.
    • Handle: RePEc:zbw:espost:167599
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/167599/1/PanelConditioning.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Geoff Masters, 1982. "A rasch model for partial credit scoring," Psychometrika, Springer;The Psychometric Society, vol. 47(2), pages 149-174, June.
    2. Daniel Kahneman & Amos Tversky, 2013. "Prospect Theory: An Analysis of Decision Under Risk," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 6, pages 99-127, World Scientific Publishing Co. Pte. Ltd..
    3. Martin Kroh, 2013. "Documentation of Sample Sizes and Panel Attrition in the German Socio Economic Panel (SOEP) (1984 until 2012)," Data Documentation 71, DIW Berlin, German Institute for Economic Research.
    4. John Robert Warren & Andrew Halpern-Manners, 2012. "Panel Conditioning in Longitudinal Social Science Surveys," Sociological Methods & Research, , vol. 41(4), pages 491-534, November.
    5. Gert G. Wagner & Joachim R. Frick & Jürgen Schupp, 2007. "The German Socio-Economic Panel Study (SOEP) – Scope, Evolution and Enhancements," Schmollers Jahrbuch : Journal of Applied Social Science Studies / Zeitschrift für Wirtschafts- und Sozialwissenschaften, Duncker & Humblot, Berlin, vol. 127(1), pages 139-169.
    6. Wolfgang Jagodzinski & Steffen M. Kãœhnel & Peter Schmidt, 1987. "Is there a “Socratic Effect†in Nonexperimental Panel Studies?," Sociological Methods & Research, , vol. 15(3), pages 259-302, February.
    7. Martin Kroh, 2012. "Documentation of Sample Sizes and Panel Attrition in the German Socio Economic Panel (SOEP) (1984 until 2011)," Data Documentation 66, DIW Berlin, German Institute for Economic Research.
    8. Rolf Porst & Klaus Zeifang, 1987. "A Description of the German General Social Survey Test-Retest Study and a Report on the Stabilities of the Sociodemographic Variables," Sociological Methods & Research, , vol. 15(3), pages 177-218, February.
    9. Michael V. Levine & Donald B. Rubin, 1979. "Measuring the Appropriateness of Multiple-Choice Test Scores," Journal of Educational and Behavioral Statistics, , vol. 4(4), pages 269-290, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Martin Kroh & Denise Lüdtke & Sandra Düzel & Florin Winter, 2016. "Response Error in a Web Survey and a Mailed Questionnaire: The Role of Cognitive Functioning," SOEPpapers on Multidisciplinary Panel Data Research 888, DIW Berlin, The German Socio-Economic Panel (SOEP).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Anger, Silke & Camehl, Georg & Peter , Frauke H., 2016. "Job Loss and Changes in Personality - Evidence from Plant Closures," VfS Annual Conference 2016 (Augsburg): Demographic Change 145940, Verein für Socialpolitik / German Economic Association.
    2. Heß, Moritz & Scheve, Christian von & Schupp, Jürgen & Wagner, Aiko & Wagner, Gert G., 2018. "Are Political Representatives More Risk-Loving Than the Electorate? Evidence from German Federal and State Parliaments," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 4, pages 1-7.
    3. Adrian Chadi, 2019. "Dissatisfied with life or with being interviewed? Happiness and the motivation to participate in a survey," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 53(3), pages 519-553, October.
    4. Andrew E. Clark & Ed Diener & Yannis Georgellis & Richard E. Lucas, 2008. "Lags And Leads in Life Satisfaction: a Test of the Baseline Hypothesis," Economic Journal, Royal Economic Society, vol. 118(529), pages 222-243, June.
    5. Andrew E. Clark & Conchita D’Ambrosio & Simone Ghislandi, 2016. "Adaptation to Poverty in Long-Run Panel Data," The Review of Economics and Statistics, MIT Press, vol. 98(3), pages 591-600, July.
    6. Olga Grigoriev & Gabriele Doblhammer, 2019. "Changing educational gradient in long-term care-free life expectancy among German men, 1997-2012," PLOS ONE, Public Library of Science, vol. 14(9), pages 1-20, September.
    7. Chang, Hsin-Li & Wu, Shun-Cheng, 2008. "Exploring the vehicle dependence behind mode choice: Evidence of motorcycle dependence in Taipei," Transportation Research Part A: Policy and Practice, Elsevier, vol. 42(2), pages 307-320, February.
    8. Caliendo, Marco & Fossen, Frank & Kritikos, Alexander, 2010. "The impact of risk attitudes on entrepreneurial survival," Journal of Economic Behavior & Organization, Elsevier, vol. 76(1), pages 45-63, October.
    9. Christoph Wunder, 2008. "Adaptation to Income over Time: A Weak Point of Subjective Well-Being," SOEPpapers on Multidisciplinary Panel Data Research 130, DIW Berlin, The German Socio-Economic Panel (SOEP).
    10. Filiz Gülal & Adam Ayaita, 2020. "The Impact of Minimum Wages on Well-Being: Evidence from a Quasi-experiment in Germany," Journal of Happiness Studies, Springer, vol. 21(7), pages 2669-2692, October.
    11. Robin Jessen & Maria Metzing & Davud Rostam-Afschar, 2017. "Optimal Taxation under Different Concepts of Justness," SOEPpapers on Multidisciplinary Panel Data Research 953, DIW Berlin, The German Socio-Economic Panel (SOEP).
    12. Jonas Beste & Markus M. Grabka & Jan Goebel, 2018. "Armut in Deutschland [Poverty in Germany]," AStA Wirtschafts- und Sozialstatistisches Archiv, Springer;Deutsche Statistische Gesellschaft - German Statistical Society, vol. 12(1), pages 27-62, April.
    13. Wunder, Christoph & Schwarze, Johannes & Krug, Gerhard & Herzog, Bodo, 2008. "Welfare effects of the euro cash changeover," European Journal of Political Economy, Elsevier, vol. 24(3), pages 571-586, September.
    14. Diriwaechter, Patric & Shvartsman, Elena, 2018. "The anticipation and adaptation effects of intra- and interpersonal wage changes on job satisfaction," Journal of Economic Behavior & Organization, Elsevier, vol. 146(C), pages 116-140.
    15. Henna Busk & Christine Dauth & Elke J. Jahn, 2017. "Do Changes in Regulation Affect Temporary Agency Workers’ Job Satisfaction?," Industrial Relations: A Journal of Economy and Society, Wiley Blackwell, vol. 56(3), pages 514-544, July.
    16. Tiefensee, Anita & Grabka, Markus M., 2016. "Comparing Wealth - Data Quality of the HFCS," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 10(2), pages 119-142.
    17. Michael Weinhardt & Alexia Meyermann & Stefan Liebig & Jürgen Schupp, 2016. "The Linked Employer-Employee Study of the Socio-Economic Panel (SOEP-LEE): Project Report," SOEPpapers on Multidisciplinary Panel Data Research 829, DIW Berlin, The German Socio-Economic Panel (SOEP).
    18. Meraner, Manuela & Musshoff, Oliver & Finger, Robert, 2018. "Using involvement to reduce inconsistencies in risk preference elicitation," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 73(C), pages 22-33.
    19. Thomas Dohmen & Armin Falk & David Huffman & Uwe Sunde, 2010. "Are Risk Aversion and Impatience Related to Cognitive Ability?," American Economic Review, American Economic Association, vol. 100(3), pages 1238-1260, June.
    20. Berlemann, Michael & Haustein, Erik & Steinhardt, Max Friedrich & Tutt, Jascha, 2024. "Do natural disasters affect household saving? Evidence from the August 2002 flood in Germany," Discussion Papers 2024/4, Free University Berlin, School of Business & Economics.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:espost:167599. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/zbwkide.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.