IDEAS home Printed from https://ideas.repec.org/p/hal/journl/hal-04926664.html
   My bibliography  Save this paper

A Distributional Analysis Of Treatment Effects In Randomized Experiments

Author

Listed:
  • Marcel Voia

    (UO - Université d'Orléans, UniBuc - University of Bucharest)

Abstract

This paper considers statistical tests that can be used to identify if a treatment is effective for a specific outcome variable over the entire distribution of a treated group when it is compared with a control group's distribution. Using only the average treatment effect to evaluate specific treatment programs ignores what happens in different regions of the distribution of interest. To address this problem, tests of equality of distributions, first and second order stochastic dominance are employed. To show how to implement the tests easily, an outline on how to estimate critical values using bootstrap method is presented. The tests are then applied to analyze the effectiveness of a treatment in a randomized experiment.I gratefully acknowledge comments and suggestions from

Suggested Citation

  • Marcel Voia, 2008. "A Distributional Analysis Of Treatment Effects In Randomized Experiments," Post-Print hal-04926664, HAL.
    • Handle: RePEc:hal:journl:hal-04926664
    Note: View the original document on HAL open archive server: https://hal.science/hal-04926664v1
    as

    Download full text from publisher

    File URL: https://hal.science/hal-04926664v1/document
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Oliver Linton & Esfandiar Maasoumi & Yoon-Jae Whang, 2005. "Consistent Testing for Stochastic Dominance under General Sampling Schemes," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 72(3), pages 735-765.
    2. Garry F. Barrett & Stephen G. Donald, 2003. "Consistent Tests for Stochastic Dominance," Econometrica, Econometric Society, vol. 71(1), pages 71-104, January.
    3. Russell Davidson & Jean-Yves Duclos, 2000. "Statistical Inference for Stochastic Dominance and for the Measurement of Poverty and Inequality," Econometrica, Econometric Society, vol. 68(6), pages 1435-1464, November.
    4. Anderson, Gordon, 1996. "Nonparametric Tests of Stochastic Dominance in Income Distributions," Econometrica, Econometric Society, vol. 64(5), pages 1183-1193, September.
    5. Abadie A., 2002. "Bootstrap Tests for Distributional Treatment Effects in Instrumental Variable Models," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 284-292, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Maasoumi, Esfandiar & Almas Heshmati, 2003. "Evaluating Dominance Ranking of PSID Incomes by various Household Attributes," Departmental Working Papers 0509, Southern Methodist University, Department of Economics.
    2. Mehmet Pinar & Thanasis Stengos & M. Ege Yazgan, 2012. "Is there an Optimal Forecast Combination? A Stochastic Dominance Approach to Forecast Combination Puzzle," Working Paper series 17_12, Rimini Centre for Economic Analysis.
    3. Donald, Stephen G. & Hsu, Yu-Chin, 2014. "Estimation and inference for distribution functions and quantile functions in treatment effect models," Journal of Econometrics, Elsevier, vol. 178(P3), pages 383-397.
    4. Oliver Linton & Kyungchui (Kevin) Song & Yoon-Jae Whang, 2008. "Bootstrap tests of stochastic dominance with asymptotic similarity on the boundary," CeMMAP working papers CWP08/08, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    5. Aaberge, Rolf & Havnes, Tarjei & Mogstad, Magne, 2013. "A Theory for Ranking Distribution Functions," IZA Discussion Papers 7738, Institute of Labor Economics (IZA).
    6. Sokbae Lee & Yoon-Jae Whang, 2009. "Nonparametric Tests of Conditional Treatment Effects," Cowles Foundation Discussion Papers 1740, Cowles Foundation for Research in Economics, Yale University.
    7. Mehmet Pinar & Thanasis Stengos & Nikolas Topaloglou, 2013. "Measuring human development: a stochastic dominance approach," Journal of Economic Growth, Springer, vol. 18(1), pages 69-108, March.
    8. Rothe, Christoph, 2010. "Nonparametric estimation of distributional policy effects," Journal of Econometrics, Elsevier, vol. 155(1), pages 56-70, March.
    9. Marcel Voia & Liqun Wang & Ricardas Zitikis, 2009. "A Distributional Analysis of Treatment Effects on Subpopulations of a Socioeconomic Experiment," Carleton Economic Papers 09-02, Carleton University, Department of Economics, revised 05 Feb 2010.
    10. Rolf Aaberge & Tarjei Havnes & Magne Mogstad, 2021. "Ranking intersecting distribution functions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 36(6), pages 639-662, September.
    11. Esfandiar Maasoumi & Daniel L. Millimet, 2005. "Robust inference concerning recent trends in US environmental quality," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(1), pages 55-77, January.
    12. Marcel Voia, 2008. "A Distributional Analysis Of Treatment Effects In Randomized Experiments," Economics Bulletin, AccessEcon, vol. 3(36), pages 1-9.
    13. Francesco Andreoli, 2018. "Robust Inference for Inverse Stochastic Dominance," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 36(1), pages 146-159, January.
    14. Agliardi, Elettra & Agliardi, Rossella & Pinar, Mehmet & Stengos, Thanasis & Topaloglou, Nikolas, 2012. "A new country risk index for emerging markets: A stochastic dominance approach," Journal of Empirical Finance, Elsevier, vol. 19(5), pages 741-761.
    15. Oliver Linton & Esfandiar Maasoumi & Yoon-Jae Wang, 2002. "Consistent testing for stochastic dominance: a subsampling approach," CeMMAP working papers 03/02, Institute for Fiscal Studies.
    16. Hooi Hooi Lean & Michael McAleer & Wing-Keung Wong, 2013. "Risk-averse and Risk-seeking Investor Preferences for Oil Spot and Futures," Documentos de Trabajo del ICAE 2013-31, Universidad Complutense de Madrid, Facultad de Ciencias Económicas y Empresariales, Instituto Complutense de Análisis Económico, revised Aug 2013.
    17. Jesus Gonzalo & Jose Olmo, 2014. "Conditional Stochastic Dominance Tests In Dynamic Settings," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 55(3), pages 819-838, August.
    18. David Lander & David Gunawan & William Griffiths & Duangkamon Chotikapanich, 2020. "Bayesian assessment of Lorenz and stochastic dominance," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 53(2), pages 767-799, May.
    19. Lean, Hooi Hooi & McAleer, Michael & Wong, Wing-Keung, 2015. "Preferences of risk-averse and risk-seeking investors for oil spot and futures before, during and after the Global Financial Crisis," International Review of Economics & Finance, Elsevier, vol. 40(C), pages 204-216.
    20. Tsang, Chun-Kei & Wong, Wing-Keung & Horowitz, Ira, 2016. "A stochastic-dominance approach to determining the optimal home-size purchase: The case of Hong Kong," MPRA Paper 69175, University Library of Munich, Germany.

    More about this item

    Keywords

    C14 C12 D31 D63 Stochastic dominance tests Randomized Experiments Effective treatment Bootstrap; C14; C12; D31; D63 Stochastic dominance tests; Randomized Experiments; Effective treatment; Bootstrap;
    All these keywords.

    JEL classification:

    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • D31 - Microeconomics - - Distribution - - - Personal Income and Wealth Distribution
    • D63 - Microeconomics - - Welfare Economics - - - Equity, Justice, Inequality, and Other Normative Criteria and Measurement
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • D31 - Microeconomics - - Distribution - - - Personal Income and Wealth Distribution
    • D63 - Microeconomics - - Welfare Economics - - - Equity, Justice, Inequality, and Other Normative Criteria and Measurement

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hal:journl:hal-04926664. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: CCSD (email available below). General contact details of provider: https://hal.archives-ouvertes.fr/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.