IDEAS home Printed from https://ideas.repec.org/a/ebl/ecbull/eb-08c10007.html
   My bibliography  Save this article

A Distributional Analysis Of Treatment Effects In Randomized Experiments

Author

Listed:
  • Marcel Voia

    (Carleton University)

Abstract

This paper considers statistical tests that can be used to identify if a treatment is effective for a specific outcome variable over the entire distribution of a treated group when it is compared with a control group's distribution. Using only the average treatment effect to evaluate specific treatment programs ignores what happens in different regions of the distribution of interest. To address this problem, tests of equality of distributions, first and second order stochastic dominance are employed. To show how to implement the tests easily, an outline on how to estimate critical values using bootstrap method is presented. The tests are then applied to analyze the effectiveness of a treatment in a randomized experiment.

Suggested Citation

  • Marcel Voia, 2008. "A Distributional Analysis Of Treatment Effects In Randomized Experiments," Economics Bulletin, AccessEcon, vol. 3(36), pages 1-9.
    • Handle: RePEc:ebl:ecbull:eb-08c10007
    as

    Download full text from publisher

    File URL: http://www.accessecon.com/pubs/EB/2008/Volume3/EB-08C10007A.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Russell Davidson & Jean-Yves Duclos, 2000. "Statistical Inference for Stochastic Dominance and for the Measurement of Poverty and Inequality," Econometrica, Econometric Society, vol. 68(6), pages 1435-1464, November.
    2. repec:mpr:mprres:4174 is not listed on IDEAS
    3. repec:mpr:mprres:2588 is not listed on IDEAS
    4. Oliver Linton & Esfandiar Maasoumi & Yoon-Jae Whang, 2005. "Consistent Testing for Stochastic Dominance under General Sampling Schemes," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 72(3), pages 735-765.
    5. Paul T. Decker & Robert B. Olsen & Lance Freeman & Daniel H. Klepinger, 2000. "Assisting Unemployment Insurance Claimants: The Long-Term Impacts of the Job Search Assistance Demonstration," Mathematica Policy Research Reports a91d342072d34545ba240f269, Mathematica Policy Research.
    6. Garry F. Barrett & Stephen G. Donald, 2003. "Consistent Tests for Stochastic Dominance," Econometrica, Econometric Society, vol. 71(1), pages 71-104, January.
    7. Anderson, Gordon, 1996. "Nonparametric Tests of Stochastic Dominance in Income Distributions," Econometrica, Econometric Society, vol. 64(5), pages 1183-1193, September.
    8. Abadie A., 2002. "Bootstrap Tests for Distributional Treatment Effects in Instrumental Variable Models," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 284-292, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marcel Voia & Liqun Wang & Ricardas Zitikis, 2009. "A Distributional Analysis of Treatment Effects on Subpopulations of a Socioeconomic Experiment," Carleton Economic Papers 09-02, Carleton University, Department of Economics, revised 05 Feb 2010.
    2. Maasoumi, Esfandiar & Almas Heshmati, 2003. "Evaluating Dominance Ranking of PSID Incomes by various Household Attributes," Departmental Working Papers 0509, Southern Methodist University, Department of Economics.
    3. Mehmet Pinar & Thanasis Stengos & M. Ege Yazgan, 2012. "Is there an Optimal Forecast Combination? A Stochastic Dominance Approach to Forecast Combination Puzzle," Working Paper series 17_12, Rimini Centre for Economic Analysis.
    4. Donald, Stephen G. & Hsu, Yu-Chin, 2014. "Estimation and inference for distribution functions and quantile functions in treatment effect models," Journal of Econometrics, Elsevier, vol. 178(P3), pages 383-397.
    5. Oliver Linton & Kyungchui (Kevin) Song & Yoon-Jae Whang, 2008. "Bootstrap tests of stochastic dominance with asymptotic similarity on the boundary," CeMMAP working papers CWP08/08, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    6. Aaberge, Rolf & Havnes, Tarjei & Mogstad, Magne, 2013. "A Theory for Ranking Distribution Functions," IZA Discussion Papers 7738, Institute of Labor Economics (IZA).
    7. Sokbae Lee & Yoon-Jae Whang, 2009. "Nonparametric Tests of Conditional Treatment Effects," Cowles Foundation Discussion Papers 1740, Cowles Foundation for Research in Economics, Yale University.
    8. Mehmet Pinar & Thanasis Stengos & Nikolas Topaloglou, 2013. "Measuring human development: a stochastic dominance approach," Journal of Economic Growth, Springer, vol. 18(1), pages 69-108, March.
    9. Rothe, Christoph, 2010. "Nonparametric estimation of distributional policy effects," Journal of Econometrics, Elsevier, vol. 155(1), pages 56-70, March.
    10. Federico A. Bugni & Ivan A. Canay & Deborah Kim, 2025. "Testing Conditional Stochastic Dominance at Target Points," Papers 2503.14747, arXiv.org, revised Apr 2025.
    11. Rolf Aaberge & Tarjei Havnes & Magne Mogstad, 2021. "Ranking intersecting distribution functions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 36(6), pages 639-662, September.
    12. Esfandiar Maasoumi & Daniel L. Millimet, 2005. "Robust inference concerning recent trends in US environmental quality," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(1), pages 55-77, January.
    13. Francesco Andreoli, 2018. "Robust Inference for Inverse Stochastic Dominance," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 36(1), pages 146-159, January.
    14. Agliardi, Elettra & Agliardi, Rossella & Pinar, Mehmet & Stengos, Thanasis & Topaloglou, Nikolas, 2012. "A new country risk index for emerging markets: A stochastic dominance approach," Journal of Empirical Finance, Elsevier, vol. 19(5), pages 741-761.
    15. Oliver Linton & Esfandiar Maasoumi & Yoon-Jae Wang, 2002. "Consistent testing for stochastic dominance: a subsampling approach," CeMMAP working papers 03/02, Institute for Fiscal Studies.
    16. Hooi Hooi Lean & Michael McAleer & Wing-Keung Wong, 2013. "Risk-averse and Risk-seeking Investor Preferences for Oil Spot and Futures," Documentos de Trabajo del ICAE 2013-31, Universidad Complutense de Madrid, Facultad de Ciencias Económicas y Empresariales, Instituto Complutense de Análisis Económico, revised Aug 2013.
    17. Jesus Gonzalo & Jose Olmo, 2014. "Conditional Stochastic Dominance Tests In Dynamic Settings," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 55(3), pages 819-838, August.
    18. David Lander & David Gunawan & William Griffiths & Duangkamon Chotikapanich, 2020. "Bayesian assessment of Lorenz and stochastic dominance," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 53(2), pages 767-799, May.
    19. Lean, Hooi Hooi & McAleer, Michael & Wong, Wing-Keung, 2015. "Preferences of risk-averse and risk-seeking investors for oil spot and futures before, during and after the Global Financial Crisis," International Review of Economics & Finance, Elsevier, vol. 40(C), pages 204-216.
    20. Tsang, Chun-Kei & Wong, Wing-Keung & Horowitz, Ira, 2016. "A stochastic-dominance approach to determining the optimal home-size purchase: The case of Hong Kong," MPRA Paper 69175, University Library of Munich, Germany.

    More about this item

    Keywords

    Stochastic dominance tests;

    JEL classification:

    • C1 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General
    • D3 - Microeconomics - - Distribution

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ebl:ecbull:eb-08c10007. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: John P. Conley (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.