IDEAS home Printed from https://ideas.repec.org/a/sae/socres/v21y2016i3p95-105.html
   My bibliography  Save this article

Is Banning Significance Testing the Best Way to Improve Applied Social Science Research? – Questions on Gorard (2016)

Author

Listed:
  • Thees F Spreckelsen
  • Mariska Van Der Horst

Abstract

Significance testing is widely used in social science research. It has long been criticised on statistical grounds and problems in the research practice. This paper is an applied researchers’ response to Gorard's (2016) ‘Damaging real lives through obstinacy: re-emphasising why significance testing is wrong’ in Sociological Research Online 21(1). He participates in this debate concluding from the issues raised that the use and teaching of significance testing should cease immediately. In that, he goes beyond a mere ban of significance testing, but claims that researchers still doing this are being unethical. We argue that his attack on applied scientists is unlikely to improve social science research and we believe he does not sufficiently prove his claims. In particular we are concerned that with a narrow focus on statistical significance, Gorard misses alternative, if not more important, explanations for the often-lamented problems in social science research. Instead, we argue that it is important to take into account the full research process, not just the step of data analysis, to get a better idea of the best evidence regarding a hypothesis.

Suggested Citation

  • Thees F Spreckelsen & Mariska Van Der Horst, 2016. "Is Banning Significance Testing the Best Way to Improve Applied Social Science Research? – Questions on Gorard (2016)," Sociological Research Online, , vol. 21(3), pages 95-105, August.
  • Handle: RePEc:sae:socres:v:21:y:2016:i:3:p:95-105
    DOI: 10.5153/sro.4076
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.5153/sro.4076
    Download Restriction: no

    File URL: https://libkey.io/10.5153/sro.4076?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Monogan, James E., 2013. "A Case for Registering Studies of Political Outcomes: An Application in the 2010 House Elections," Political Analysis, Cambridge University Press, vol. 21(1), pages 21-37, January.
    2. James Nicholson & Sean Mccusker, 2016. "Damaging the Case for Improving Social Science Methodology through Misrepresentation: Re-Asserting Confidence in Hypothesis Testing as a Valid Scientific Process," Sociological Research Online, , vol. 21(2), pages 136-147, May.
    3. Anna, Petrenko, 2016. "Мaркування готової продукції як складова частина інформаційного забезпечення маркетингової діяльності підприємств овочепродуктового підкомплексу," Agricultural and Resource Economics: International Scientific E-Journal, Agricultural and Resource Economics: International Scientific E-Journal, vol. 2(1), March.
    4. Stephen Gorard, 2016. "Damaging Real Lives through Obstinacy: Re-Emphasising Why Significance Testing is Wrong," Sociological Research Online, , vol. 21(1), pages 102-115, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Benjamin A. T. Graham & Jacob R. Tucker, 2019. "The international political economy data resource," The Review of International Organizations, Springer, vol. 14(1), pages 149-161, March.
    2. Vivian Welch & Christine M. Mathew & Panteha Babelmorad & Yanfei Li & Elizabeth T. Ghogomu & Johan Borg & Monserrat Conde & Elizabeth Kristjansson & Anne Lyddiatt & Sue Marcus & Jason W. Nickerson & K, 2021. "Health, social care and technological interventions to improve functional ability of older adults living at home: An evidence and gap map," Campbell Systematic Reviews, John Wiley & Sons, vol. 17(3), September.
    3. Persson, Petra & Qiu, Xinyao & Rossin-Slater, Maya, 2021. "Family Spillover Effects of Marginal Diagnoses: The Case of ADHD," IZA Discussion Papers 14020, Institute of Labor Economics (IZA).
    4. Menkhoff, Lukas & Miethe, Jakob, 2019. "Tax evasion in new disguise? Examining tax havens' international bank deposits," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 176, pages 53-78.
    5. Ran Abramitzky & Roy Mill & Santiago Pérez, 2020. "Linking individuals across historical sources: A fully automated approach," Historical Methods: A Journal of Quantitative and Interdisciplinary History, Taylor & Francis Journals, vol. 53(2), pages 94-111, April.
    6. Werner Eichhorst & Ulf Rinne, 2017. "Digital Challenges for the Welfare State," CESifo Forum, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 18(04), pages 03-08, December.
    7. Sant'Anna, Ana Claudia & Bergtold, Jason & Shanoyan, Aleksan & Caldas, Marcellus & Granco, Gabriel, 2021. "Deal or No Deal? Analysis of Bioenergy Feedstock Contract Choice with Multiple Opt-out Options and Contract Attribute Substitutability," 2021 Conference, August 17-31, 2021, Virtual 315289, International Association of Agricultural Economists.
    8. Tommaso Colussi & Ingo E. Isphording & Nico Pestel, 2021. "Minority Salience and Political Extremism," American Economic Journal: Applied Economics, American Economic Association, vol. 13(3), pages 237-271, July.
    9. Erkmen Giray Aslim, 2019. "The Relationship Between Health Insurance and Early Retirement: Evidence from the Affordable Care Act," Eastern Economic Journal, Palgrave Macmillan;Eastern Economic Association, vol. 45(1), pages 112-140, January.
    10. Balint, T. & Lamperti, F. & Mandel, A. & Napoletano, M. & Roventini, A. & Sapio, A., 2017. "Complexity and the Economics of Climate Change: A Survey and a Look Forward," Ecological Economics, Elsevier, vol. 138(C), pages 252-265.
    11. Edna P. Conwi & Alexander G. Cortez & Normita Ramos, 2016. "Effects of the Dualized Training Program on the Occupational Interest of the Students Enrolled in Bachelor of Science in Hotel and Restaurant Management," Indian Journal of Commerce and Management Studies, Educational Research Multimedia & Publications,India, vol. 7(1), pages 31-36, January.
    12. Nihan Akyelken, 2017. "Mobility-Related Economic Exclusion: Accessibility and Commuting Patterns in Industrial Zones in Turkey," Social Inclusion, Cogitatio Press, vol. 5(4), pages 175-182.
    13. Youngna Choi, 2022. "Economic Stimulus and Financial Instability: Recent Case of the U.S. Household," JRFM, MDPI, vol. 15(6), pages 1-25, June.
    14. Camillia Kong & John Coggon & Michael Dunn & Penny Cooper, 2019. "Judging Values and Participation in Mental Capacity Law," Laws, MDPI, vol. 8(1), pages 1-22, February.
    15. Dreher, Axel & Fuchs, Andreas & Langlotz, Sarah, 2019. "The effects of foreign aid on refugee flows," European Economic Review, Elsevier, vol. 112(C), pages 127-147.
    16. Dindo, Pietro & Massari, Filippo, 2020. "The wisdom of the crowd in dynamic economies," Theoretical Economics, Econometric Society, vol. 15(4), November.
    17. Ferrarini, Benno & Maupin, Julie & Hinojales , Marthe, 2017. "Distributed Ledger Technologies for Developing Asia," ADB Economics Working Paper Series 533, Asian Development Bank.
    18. Andrzej Cieślik & Sarhad Hamza, 2022. "Inward FDI, IFRS Adoption and Institutional Quality: Insights from the MENA Countries," IJFS, MDPI, vol. 10(3), pages 1-19, June.
    19. Georg Feigl & Markus Marterbauer & Miriam Rehm & Matthias Schnetzer & Sepp Zuckerstätter & Lars Nørvang Andersen & Thea Nissen & Signe Dahl & Peter Hohlfeld & Benjamin Lojak & Achim Truger & Andrew Wa, 2016. "The Elusive Recovery," SciencePo Working papers Main hal-03459084, HAL.
      • Georg Feigl & Markus Marterbauer & Miriam Rehm & Matthias Schnetzer & Sepp Zuckerstätter & Lars Nørvang Andersen & Thea Nissen & Signe Dahl & Peter Hohlfeld & Benjamin Lojak & Achim Truger & Andrew Wa, 2016. "The Elusive Recovery," PSE-Ecole d'économie de Paris (Postprint) hal-03459084, HAL.
      • Georg Feigl & Markus Marterbauer & Miriam Rehm & Matthias Schnetzer & Sepp Zuckerstätter & Lars Nørvang Andersen & Thea Nissen & Signe Dahl & Peter Hohlfeld & Benjamin Lojak & Thomas Theobald & Achim , 2016. "The Elusive Recovery," PSE Working Papers hal-03612850, HAL.
      • Georg Feigl & Markus Marterbauer & Miriam Rehm & Matthias Schnetzer & Sepp Zuckerstätter & Lars Nørvang Andersen & Thea Nissen & Signe Dahl & Peter Hohlfeld & Benjamin Lojak & Achim Truger & Andrew Wa, 2016. "The Elusive Recovery," Post-Print hal-03459084, HAL.
      • Georg Feigl & Markus Marterbauer & Miriam Rehm & Matthias Schnetzer & Sepp Zuckerstätter & Lars Nørvang Andersen & Thea Nissen & Signe Dahl & Peter Hohlfeld & Benjamin Lojak & Thomas Theobald & Achim , 2016. "The Elusive Recovery," Working Papers hal-03612850, HAL.
      • Georg Feigl & Markus Marterbauer & Miriam Rehm & Matthias Schnetzer & Sepp Zuckerstätter & Lars Nørvang Andersen & Thea Nissen & Signe Dahl & Peter Hohlfeld & Benjamin Lojak & Thomas Theobald & Achim , 2016. "The Elusive Recovery," SciencePo Working papers Main hal-03612850, HAL.
      • Georg Feigl & Markus Marterbauer & Miriam Rehm & Matthias Schnetzer & Sepp Zuckerstätter & Lars Nørvang Andersen & Thea Nissen & Signe Dahl & Peter Hohlfeld & Benjamin Lojak & Thomas Theobald & Achim , 2016. "The Elusive Recovery," PSE-Ecole d'économie de Paris (Postprint) hal-03612850, HAL.
    20. Billari, Francesco C. & Giuntella, Osea & Stella, Luca, 2018. "Broadband internet, digital temptations, and sleep," Journal of Economic Behavior & Organization, Elsevier, vol. 153(C), pages 58-76.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:socres:v:21:y:2016:i:3:p:95-105. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.