IDEAS home Printed from https://ideas.repec.org/p/osf/socarx/xshdw_v1.html
   My bibliography  Save this paper

Nonresponse bias in public leadership research: An empirical assessment

Author

Listed:
  • Vogel, Dominik

    (Harz University of Applied Sciences)

  • Jacobsen, Christian Bøtcher

Abstract

Self-reported measures of leadership are widely used in public management research, but nonresponse bias poses a threat to the validity of these data. Although this measurement problem is acknowledged, it has received limited empirical attention because nonresponse bias is inherently challenging to study. To address this issue, we examine nonresponse bias among public managers by analyzing multilevel surveys of managers and employees in which we can compare employee ratings of leadership for both responding and nonresponding managers. Using 16,531 employee responses spread over six datasets from three countries, we find only limited evidence of nonresponse bias in managers’ self-reported leadership. Additional Bayesian analyses indicate that—overall—the data are indicative of the absence of substantial nonresponse bias. However, the results vary between datasets and call for more research on nonresponse bias in leadership research.

Suggested Citation

  • Vogel, Dominik & Jacobsen, Christian Bøtcher, 2021. "Nonresponse bias in public leadership research: An empirical assessment," SocArXiv xshdw_v1, Center for Open Science.
  • Handle: RePEc:osf:socarx:xshdw_v1
    DOI: 10.31219/osf.io/xshdw_v1
    as

    Download full text from publisher

    File URL: https://osf.io/download/6345806624289c26a4c12f2e/
    Download Restriction: no

    File URL: https://libkey.io/10.31219/osf.io/xshdw_v1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Joshua D. Angrist & Jörn-Steffen Pischke, 2010. "The Credibility Revolution in Empirical Economics: How Better Research Design Is Taking the Con out of Econometrics," Journal of Economic Perspectives, American Economic Association, vol. 24(2), pages 3-30, Spring.
    2. Rick Vogel & Doris Masal, 2015. "Public Leadership: A review of the literature and framework for future research," Public Management Review, Taylor & Francis Journals, vol. 17(8), pages 1165-1189, September.
    3. Vogel, Dominik & Kroll, Alexander, 2019. "Agreeing to Disagree? Explaining Self–Other Disagreement on Leadership Behaviour," SocArXiv 62ngj_v1, Center for Open Science.
    4. Armstrong, J. Scott & Overton, Terry S., 1977. "Estimating Nonresponse Bias in Mail Surveys," MPRA Paper 81694, University Library of Munich, Germany.
    5. Viechtbauer, Wolfgang, 2010. "Conducting Meta-Analyses in R with the metafor Package," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 36(i03).
    6. Dominik Vogel & Alexander Kroll, 2019. "Agreeing to disagree? Explaining self–other disagreement on leadership behaviour," Public Management Review, Taylor & Francis Journals, vol. 21(12), pages 1867-1892, December.
    7. Ronald L. Wasserstein & Nicole A. Lazar, 2016. "The ASA's Statement on p -Values: Context, Process, and Purpose," The American Statistician, Taylor & Francis Journals, vol. 70(2), pages 129-133, May.
    8. Vogel, Dominik, 2018. "Vogel (2018): Matching survey responses with anonymity in environments with privacy concerns: A practical guide," SocArXiv nwjd7, Center for Open Science.
    9. Nosek, BA & Alter, G & Banks, GC & Borsboom, D & Bowman, SD & Breckler, SJ & Buck, S & Chambers, CD & Chin, G & Christensen, G & Contestabile, M & Dafoe, A & Eich, E & Freese, J & Glennerster, R & Gor, 2015. "Promoting an open research culture," Department of Economics, Working Paper Series qt7wh1000s, Department of Economics, Institute for Business and Economic Research, UC Berkeley.
    10. Vogel, Dominik & Kroll, Alexander, 2019. "Agreeing to Disagree? Explaining Self–Other Disagreement on Leadership Behaviour," SocArXiv 62ngj, Center for Open Science.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Vogel, Dominik & Kroll, Alexander, 2019. "Agreeing to Disagree? Explaining Self–Other Disagreement on Leadership Behaviour," SocArXiv 62ngj, Center for Open Science.
    2. Nambisan, Satish & Baron, Robert A., 2021. "On the costs of digital entrepreneurship: Role conflict, stress, and venture performance in digital platform-based ecosystems," Journal of Business Research, Elsevier, vol. 125(C), pages 520-532.
    3. Nicolas Vallois & Dorian Jullien, 2018. "A history of statistical methods in experimental economics," The European Journal of the History of Economic Thought, Taylor & Francis Journals, vol. 25(6), pages 1455-1492, November.
    4. Nicolas Vallois & Dorian Jullien, 2017. "Estimating Rationality in Economics: A History of Statistical Methods in Experimental Economics," Working Papers halshs-01651070, HAL.
    5. Konstantin Flassak & Julia Haag & Christian Hofmann & Christopher Lechner & Nina Schwaiger & Rafael Zacherl, 2023. "Working from home and management controls," Journal of Business Economics, Springer, vol. 93(1), pages 193-228, January.
    6. Oxley, Florence A.R. & Wilding, Kirsty & von Stumm, Sophie, 2024. "DNA and IQ: Big deal or much ado about nothing? – A meta-analysis," Intelligence, Elsevier, vol. 107(C).
    7. Jeremy Arkes, 2020. "Teaching Graduate (and Undergraduate) Econometrics: Some Sensible Shifts to Improve Efficiency, Effectiveness, and Usefulness," Econometrics, MDPI, vol. 8(3), pages 1-23, September.
    8. Furukawa, Chishio, 2019. "Publication Bias under Aggregation Frictions: Theory, Evidence, and a New Correction Method," EconStor Preprints 194798, ZBW - Leibniz Information Centre for Economics.
    9. Marco Colagrossi & Domenico Rossignoli & Mario A. Maggioni, 2017. "Does democracy cause growth? A meta-analysis perspective," DISEIS - Quaderni del Dipartimento di Economia internazionale, delle istituzioni e dello sviluppo dis1703, Università Cattolica del Sacro Cuore, Dipartimento di Economia internazionale, delle istituzioni e dello sviluppo (DISEIS).
    10. Czajkowski, Mikołaj & Zagórska, Katarzyna & Letki, Natalia & Tryjanowski, Piotr & Wąs, Adam, 2021. "Drivers of farmers’ willingness to adopt extensive farming practices in a globally important bird area," Land Use Policy, Elsevier, vol. 107(C).
    11. Yoon, Junghyun & Lee, Hee Yong & Dinwoodie, John, 2015. "Competitiveness of container terminal operating companies in South Korea and the industry–university–government network," Transportation Research Part A: Policy and Practice, Elsevier, vol. 80(C), pages 1-14.
    12. Sousa, Carlos M.P. & Bradley, Frank, 2008. "Antecedents of international pricing adaptation and export performance," Journal of World Business, Elsevier, vol. 43(3), pages 307-320, July.
    13. KAMKOUM, Arnaud Cedric, 2023. "The Federal Reserve’s Response to the Global Financial Crisis and its Effects: An Interrupted Time-Series Analysis of the Impact of its Quantitative Easing Programs," Thesis Commons d7pvg, Center for Open Science.
    14. Son K. Lam & Thomas E. DeCarlo & Ashish Sharma, 2019. "Salesperson ambidexterity in customer engagement: do customer base characteristics matter?," Journal of the Academy of Marketing Science, Springer, vol. 47(4), pages 659-680, July.
    15. Van Wijk, Raymond & Nadolska, Anna, 2020. "Making more of alliance portfolios: The role of alliance portfolio coordination," European Management Journal, Elsevier, vol. 38(3), pages 388-399.
    16. Jarle Aarstad & Olav Andreas Kvitastein & Stig-Erik Jakobsen, 2019. "What Drives Enterprise Product Innovation? Assessing How Regional, National, And International Inter-Firm Collaboration Complement Or Substitute For R&D Investments," International Journal of Innovation Management (ijim), World Scientific Publishing Co. Pte. Ltd., vol. 23(05), pages 1-25, June.
    17. Aziz Barhmi & Omar Hajaji, 2023. "Multidisciplinary Approach to Supply Chain Resilience: Conceptualization and Scale Development," Central European Business Review, Prague University of Economics and Business, vol. 2023(5), pages 43-69.
    18. Franck Brulhart & Sandrine Gherra & Bertrand V. Quelin, 2019. "Do Stakeholder Orientation and Environmental Proactivity Impact Firm Profitability?," Journal of Business Ethics, Springer, vol. 158(1), pages 25-46, August.
    19. Chin-Shan Lu & Kuo-Chung Shang & Chi-Chang Lin, 2016. "Examining sustainability performance at ports: port managers’ perspectives on developing sustainable supply chains," Maritime Policy & Management, Taylor & Francis Journals, vol. 43(8), pages 909-927, November.
    20. Van Gils, Anita & Huybrechts, Jolien & Minola, Tommaso & Cassia, Lucio, 2019. "Unraveling the impact of family antecedents on family firm image: A serial multiple-mediation model," Journal of Family Business Strategy, Elsevier, vol. 10(1), pages 17-27.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:socarx:xshdw_v1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://arabixiv.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.