IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp11867.html
   My bibliography  Save this paper

Some (Maybe) Unpleasant Arithmetic in Minimum Wage Evaluations: The Role of Power, Significance and Sample Size

Author

Listed:
  • Bachmann, Ronald

    (RWI)

  • Felder, Rahel

    (Ruhr University Bochum)

  • Schaffner, Sandra

    (RWI)

  • Tamm, Marcus

    (Hochschule der Bundesagentur für Arbeit (HdBA))

Abstract

In this paper, we discuss the importance of sample size in the evaluation of minimum wage effects. We first show which sample sizes are necessary to make reliable statements about the effects of minimum wages on binary outcomes, and second how to determine these sample sizes. This is particularly important when interpreting statistically insignificant effects, which could be due to (i) the absence of a true effect or (ii) lack of statistical power, which makes it impossible to detect an effect even though it exists. We illustrate this for the analysis of labour market transitions using two data sets which are particularly important in the minimum wage research for Germany, the Integrated Labour Market Biographies (IEB) and the Socio-Economic Panel (SOEP).

Suggested Citation

  • Bachmann, Ronald & Felder, Rahel & Schaffner, Sandra & Tamm, Marcus, 2018. "Some (Maybe) Unpleasant Arithmetic in Minimum Wage Evaluations: The Role of Power, Significance and Sample Size," IZA Discussion Papers 11867, Institute of Labor Economics (IZA).
    • Handle: RePEc:iza:izadps:dp11867
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp11867.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Pierre Brochu & David A. Green, 2013. "The Impact of Minimum Wages on Labour Market Transitions," Economic Journal, Royal Economic Society, vol. 123(12), pages 1203-1235, December.
    2. Aretz Bodo & Gregory Terry & Arntz Melanie, 2013. "The Minimum Wage Affects Them All: Evidence on Employment Spillovers in the Roofing Sector," German Economic Review, De Gruyter, vol. 14(3), pages 282-315, August.
    3. Kluve, Jochen & Schaffner, Sandra & Schmidt, Christoph M., 2006. "Labor Force Status Dynamics in the German Labor Market: Individual Heterogeneity and Cyclical Sensitivity," Technical Reports 2006,20, Technische Universität Dortmund, Sonderforschungsbereich 475: Komplexitätsreduktion in multivariaten Datenstrukturen.
    4. Neumark David, 2019. "The Econometrics and Economics of the Employment Effects of Minimum Wages: Getting from Known Unknowns to Known Knowns," German Economic Review, De Gruyter, vol. 20(3), pages 293-329, August.
    5. Hanna Frings, 2013. "The Employment Effect of Industry-Specific, Collectively Bargained Minimum Wages," German Economic Review, Verein für Socialpolitik, vol. 14(3), pages 258-281, August.
    6. Bachmann, Ronald & Penninger, Marion & Schaffner, Sandra, 2015. "The effect of minimum wages on labour market flows: Evidence from Germany," Ruhr Economic Papers 598, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    7. Bachmann, Ronald & Schaffner, Sandra, 2009. "Biases in the measurement of labour market dynamics," Technical Reports 2009,12, Technische Universität Dortmund, Sonderforschungsbereich 475: Komplexitätsreduktion in multivariaten Datenstrukturen.
    8. Michael Zibrowius, 2012. "Convergence or Divergence?: Immigrant Wage Assimilation Patterns in Germany," SOEPpapers on Multidisciplinary Panel Data Research 479, DIW Berlin, The German Socio-Economic Panel (SOEP).
    9. Eric W. Djimeu & Deo-Gracias Houndolo, 2016. "Power calculation for causal inference in social science: sample size and minimum detectable effect determination," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 8(4), pages 508-527, October.
    10. Bonin, Holger & Isphording, Ingo E. & Krause-Pilatus, Annabelle & Lichter, Andreas & Pestel, Nico & Rinne, Ulf & al., et, 2018. "Auswirkungen des gesetzlichen Mindestlohns auf Beschäftigung, Arbeitszeit und Arbeitslosigkeit," IZA Research Reports 83, Institute of Labor Economics (IZA).
    11. Patrick Burauel & Marco Caliendo & Alexandra Fedorets & Markus M. Grabka & Carsten Schröder & Jürgen Schupp & Linda Wittbrodt, 2017. "Mindestlohn noch längst nicht für alle – Zur Entlohnung anspruchsberechtigter Erwerbstätiger vor und nach der Mindestlohnreform aus der Perspektive Beschäftigter," DIW Wochenbericht, DIW Berlin, German Institute for Economic Research, vol. 84(49), pages 1109-1123.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bachmann, Ronald & Boockmann, Bernhard & Cim, Merve & Felder, Rahel & Frings, Hanna & Janisch, Laura M. & Schaffner, Sandra & Späth, Jochen & Tamm, Marcus, 2018. "Vergleich von Datenquellen für eine Analyse von Übergängen am Arbeitsmarkt: Studie im Auftrag der Mindestlohnkommission," RWI Projektberichte, RWI - Leibniz-Institut für Wirtschaftsforschung, number 180217, March.
    2. Bossler, Mario & Gürtzgen, Nicole & Lochner, Benjamin & Betzl, Ute & Feist, Lisa & Wegmann, Jakob, 2018. "Auswirkungen des gesetzlichen Mindestlohns auf Betriebe und Unternehmen," IAB-Forschungsbericht 201804, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    3. Caliendo Marco & Wittbrodt Linda & Schröder Carsten, 2019. "The Causal Effects of the Minimum Wage Introduction in Germany – An Overview," German Economic Review, De Gruyter, vol. 20(3), pages 257-292, August.
    4. Mario Bossler & Hans-Dieter Gerner, 2020. "Employment Effects of the New German Minimum Wage: Evidence from Establishment-Level Microdata," ILR Review, Cornell University, ILR School, vol. 73(5), pages 1070-1094, October.
    5. Bossler, Mario & Gürtzgen, Nicole & Lochner, Benjamin & Betzl, Ute & Feist, Lisa, 2018. "The German minimum wage: Effects on business expectations, profitability, and investments," FAU Discussion Papers in Economics 13/2018, Friedrich-Alexander University Erlangen-Nuremberg, Institute for Economics.
    6. Burauel, Patrick & Caliendo, Marco & Grabka, Markus M. & Obst, Cosima & Preuss, Malte & Schröder, Carsten & Shupe, Cortnie, 2020. "The Impact of the German Minimum Wage on Individual Wages and Monthly Earnings," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 240(2/3), pages 201-231.
    7. Bachmann, Ronald & Boockmann, Bernhard & Gonschor, Myrielle & Kalweit, René & Klauser, Roman & Laub, Natalie & Rulff, Christian & Vonnahme, Christina, 2022. "Auswirkungen des gesetzlichen Mindestlohns auf Löhne und Arbeitszeiten," RWI Projektberichte, RWI - Leibniz-Institut für Wirtschaftsforschung, number 264288, March.
    8. Bachmann, Ronald & Bonin, Holger & Boockmann, Bernhard & Demir, Gökay & Felder, Rahel & Isphording, Ingo & Kalweit, René & Laub, Natalie & Vonnahme, Christina & Zimpelmann, Christian, 2020. "Auswirkungen des gesetzlichen Mindestlohns auf Löhne und Arbeitszeiten: Studie im Auftrag der Mindestlohnkommission," RWI Projektberichte, RWI - Leibniz-Institut für Wirtschaftsforschung, number 222998, March.
    9. Schumann, Mathias, 2017. "The effects of minimum wages on firm-financed apprenticeship training," Labour Economics, Elsevier, vol. 47(C), pages 163-181.
    10. Ronald Bachmann & Hanna Frings, 2017. "Monopsonistic competition, low-wage labour markets, and minimum wages – An empirical analysis," Applied Economics, Taylor & Francis Journals, vol. 49(51), pages 5268-5286, November.
    11. Koch, Andreas & Kirchmann, Andrea & Reiner, Marcel & Scheu, Tobias & Boockmann, Bernhard & Bonin, Holger, 2018. "Verhaltensmuster von Betrieben und Beschäftigten im Zuge der Einführung des gesetzlichen Mindestlohns," IZA Research Reports 84, Institute of Labor Economics (IZA).
    12. Philipp Berge & Hanna Frings, 2020. "High-impact minimum wages and heterogeneous regions," Empirical Economics, Springer, vol. 59(2), pages 701-729, August.
    13. Pestel, Nico & Bonin, Holger & Isphording, Ingo E. & Gregory, Terry & Caliendo, Marco, 2020. "Auswirkungen des gesetzlichen Mindestlohns auf Beschäftigung und Arbeitslosigkeit," IZA Research Reports 95, Institute of Labor Economics (IZA).
    14. Lei Xu & Yu Zhu, 2023. "Does the employment effect of national minimum wage vary by non‐employment rate? A regression discontinuity approach," Manchester School, University of Manchester, vol. 91(1), pages 18-36, January.
    15. Marco Caliendo & Alexandra Fedorets & Malte Preuss & Carsten Schröder & Linda Wittbrodt, 2023. "The short- and medium-term distributional effects of the German minimum wage reform," Empirical Economics, Springer, vol. 64(3), pages 1149-1175, March.
    16. Nordmeier, Daniela, 2014. "Worker flows in Germany: Inspecting the time aggregation bias," Labour Economics, Elsevier, vol. 28(C), pages 70-83.
    17. Mario Bossler, 2017. "Employment expectations and uncertainties ahead of the new German minimum wage," Scottish Journal of Political Economy, Scottish Economic Society, vol. 64(4), pages 327-348, September.
    18. Garloff, Alfred, 2016. "Side effects of the new German minimum wage on (un-)employment : first evidence from regional data," IAB-Discussion Paper 201631, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    19. Lucas Hafner & Benjamin Lochner, 2022. "Do minimum wages improve self-rated health? Evidence from a natural experiment," Empirical Economics, Springer, vol. 62(6), pages 2989-3014, June.
    20. Bachmann, Ronald & König, Marion & Schaffner, Sandra, 2012. "Lost in Transition? Minimum Wage Effects on German Construction Workers," IZA Discussion Papers 6760, Institute of Labor Economics (IZA).

    More about this item

    Keywords

    power calculation; sample size; significance testing; evaluation; minimum wage;
    All these keywords.

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C80 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - General
    • J38 - Labor and Demographic Economics - - Wages, Compensation, and Labor Costs - - - Public Policy

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp11867. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.