IDEAS home Printed from https://ideas.repec.org/a/spr/qualqt/v57y2023i2d10.1007_s11135-022-01385-x.html
   My bibliography  Save this article

The power of online panel paradata to predict unit nonresponse and voluntary attrition in a longitudinal design

Author

Listed:
  • Sebastian Kocar

    (University of Tasmania)

  • Nicholas Biddle

    (The Australian National University)

Abstract

The objective of this study is to identify factors affecting participation rates, i.e., nonresponse and voluntary attrition rates, and their predictive power in a probability-based online panel. Participation for this panel had already been investigated in the literature according to the socio-demographic and socio-psychological characteristics of respondents and different types of paradata, such as device type or questionnaire navigation, had also been explored. In this study, the predictive power of online panel participation paradata was instead evaluated, which was expected (at least in theory) to offer even more complex insight into respondents’ behavior over time. This kind of paradata would also enable the derivation of longitudinal variables measuring respondents’ panel activity, such as survey outcome rates and consecutive waves with a particular survey outcome prior to a wave (e.g., response, noncontact, refusal), and could also be used in models controlling for unobserved heterogeneity. Using the Life in Australia™ participation data for all recruited members for the first 30 waves, multiple linear, binary logistic and panel random-effect logit regression analyses were carried out to assess socio-demographic and online panel paradata predictors of nonresponse and attrition that were available and contributed to the accuracy of prediction and the best statistical modeling. The proposed approach with the derived paradata predictors and random-effect logistic regression proved to be reasonably accurate for predicting nonresponse—with just 15 waves of online panel paradata (even without sociodemographics) and logit random-effect modeling almost four out of five nonrespondents could be correctly identified in the subsequent wave.

Suggested Citation

  • Sebastian Kocar & Nicholas Biddle, 2023. "The power of online panel paradata to predict unit nonresponse and voluntary attrition in a longitudinal design," Quality & Quantity: International Journal of Methodology, Springer, vol. 57(2), pages 1055-1078, April.
    • Handle: RePEc:spr:qualqt:v:57:y:2023:i:2:d:10.1007_s11135-022-01385-x
    DOI: 10.1007/s11135-022-01385-x
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11135-022-01385-x
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11135-022-01385-x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Frankel, Laura Lazarus & Hillygus, D. Sunshine, 2014. "Looking Beyond Demographics: Panel Attrition in the ANES and GSS," Political Analysis, Cambridge University Press, vol. 22(3), pages 336-353, July.
    2. Francesco Bartolucci & Valentina Nigro, 2010. "A Dynamic Model for Binary Panel Data With Unobserved Heterogeneity Admitting a √n-Consistent Conditional Estimator," Econometrica, Econometric Society, vol. 78(2), pages 719-733, March.
    3. Cheng Hsiao, 2007. "Panel data analysis—advantages and challenges," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 16(1), pages 1-22, May.
    4. Couper, Mick P. & Kapteyn, Arie & Schonlau, Matthias & Winter, Joachim, 2007. "Noncoverage and nonresponse in an Internet survey," Munich Reprints in Economics 20093, University of Munich, Department of Economics.
    5. Noah Uhrig, S.C., 2008. "The nature and causes of attrition in the British Household Panel Study," ISER Working Paper Series 2008-05, Institute for Social and Economic Research.
    6. Cheng Hsiao, 2007. "Rejoinder on: Panel data analysis—advantages and challenges," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 16(1), pages 56-57, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hany Eldemerdash & Hugh Metcalf & Sara Maioli, 2014. "Twin deficits: new evidence from a developing (oil vs. non-oil) countries’ perspective," Empirical Economics, Springer, vol. 47(3), pages 825-851, November.
    2. Ding Luo & Oded Cats & Hans Lint, 2020. "Can passenger flow distribution be estimated solely based on network properties in public transport systems?," Transportation, Springer, vol. 47(6), pages 2757-2776, December.
    3. Li, Larry & McMurray, Adela & Sy, Malick & Xue, Jinjun, 2018. "Corporate ownership, efficiency and performance under state capitalism: Evidence from China," Journal of Policy Modeling, Elsevier, vol. 40(4), pages 747-766.
    4. Almudena Moreno-Mínguez & Marta Ortega-Gaspar & Carlos Gamero-Burón, 2018. "A Socio-Structural Perspective on Family Model Preferences, Gender Roles and Work–Family Attitudes in Spain," Social Sciences, MDPI, vol. 8(1), pages 1-23, December.
    5. Dzintra Atstāja & Edmira Cakrani, 2024. "Impact of Climate Change on International Tourism Evidence from Baltic Sea Countries," Sustainability, MDPI, vol. 16(12), pages 1-16, June.
    6. Susanne Fricke & Lodovico Muratori, 2017. "Spatial price transmission and trade policies: new evidence for agricultural products from selected sub-Saharan African countries with high frequency data," Working Papers 5/17, Sapienza University of Rome, DISS.
    7. Lynn, Peter & Bosch, Oriol, 2021. "Methodological lessons from the pilot longitudinal survey on debt advice," ISER Working Paper Series 2021-03, Institute for Social and Economic Research.
    8. Fang Yin & Zhanli Sun & Liangzhi You & Daniel Müller, 2024. "Determinants of changes in harvested area and yields of major crops in China," Food Security: The Science, Sociology and Economics of Food Production and Access to Food, Springer;The International Society for Plant Pathology, vol. 16(2), pages 339-351, April.
    9. Mehmet H. TOPAL & Özlem S. GÜL, 2016. "The Effect of Country Risk on Foreign Direct Investment: A Dynamic Panel Data Analysis for Developing Countries," Journal of Economics Library, KSP Journals, vol. 3(1), pages 141-155, March.
    10. Yasser Razak Hussain & Pranab Mukhopadhyay, 2023. "How Much do Education, Experience, and Social Networks Impact Earnings in India? A Panel Data Analysis Disaggregated by Class, Gender, Caste and Religion," SAGE Open, , vol. 13(4), pages 21582440231, December.
    11. Wambua, Dennis Kyalo, 2017. "Influence Of Social Capital And Networks On Marketing Performance Of Smallholder Grain Farmer Groups In Tharaka North And Tharaka South Sub-Counties, Kenya," Research Theses 276430, Collaborative Masters Program in Agricultural and Applied Economics.
    12. Alice Hengevoss, 2021. "Assessing the Impact of Nonprofit Organizations on Multi-Actor Global Governance Initiatives: The Case of the UN Global Compact," Sustainability, MDPI, vol. 13(13), pages 1-13, June.
    13. Trabelsi, Emna & Hichri, Walid, 2021. "Central Bank Transparency with (semi-)public Information: Laboratory Experiments," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 90(C).
    14. Costin Andrei ISTRATE, 2017. "Comparative analysis of evaluation models in insurance solvency," Theoretical and Applied Economics, Asociatia Generala a Economistilor din Romania / Editura Economica, vol. 0(Special), pages 27-36.
    15. Mohamed Elheddad & Mohga Bassim & Rizwan Ahmed, 2021. "FDI and economic growth in the GCC: does the oil sector matter?," Economics and Business Letters, Oviedo University Press, vol. 10(3), pages 178-190.
    16. Noor Zainab.Tunggal & Shariff Umar Shariff Abd. Kadir & Venus-Khim Sen Liew, 2018. "Panel Analysis of Monetary Model of ASEAN-5 Exchange Rates," International Business Research, Canadian Center of Science and Education, vol. 11(11), pages 1-7, November.
    17. Shailesh Rastogi & Geetanjali Pinto & Amit Kumar Pathak & Satyendra Pratap Singh & Arpita Sharma & Souvik Banerjee & Jagjeevan Kanoujiya & Pracheta Tejasmayee, 2023. "Influence of Transparency and Disclosures on the Dividend Distribution Decisions in the Firms: Do Profitability and Efficiency of Firms Matter?," IJFS, MDPI, vol. 11(4), pages 1-16, December.
    18. Wanglin Ma & Kathryn Bicknell & Alan Renwick, 2019. "Feed use intensification and technical efficiency of dairy farms in New Zealand," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 63(1), pages 20-38, January.
    19. Martey, Edward & Etwire, Prince Maxwell & Abdoulaye, Tahirou, 2020. "Welfare impacts of climate-smart agriculture in Ghana: Does row planting and drought-tolerant maize varieties matter?," Land Use Policy, Elsevier, vol. 95(C).
    20. Wenhao Song & Chunhui Ye & Yuheng Liu & Weisong Cheng, 2021. "Do China’s Urban–Environmental Quality and Economic Growth Conform to the Environmental Kuznets Curve?," IJERPH, MDPI, vol. 18(24), pages 1-15, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:qualqt:v:57:y:2023:i:2:d:10.1007_s11135-022-01385-x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.