IDEAS home Printed from https://ideas.repec.org/a/sae/evarev/v29y2005i2p178-196.html
   My bibliography  Save this article

Using Cluster Analysis in Program Evaluation

Author

Listed:
  • Laura R. Peck

    (Arizona State University)

Abstract

The conventional way to measure program impacts is to compute the average treatment effect; that is, the difference between a treatment group that received some intervention and a control group that did not. Recently, scholars have recognized that looking only at the average treatment effect may obscure impacts that accrue to subgroups. In an effort to inform subgroup analysis research, this article explains the challenge of treatment group heterogeneity. It then proposes using cluster analysis to identify otherwise difficult-to-identify subgroups within evaluation data. The approach maintains the integrity of the experimental evaluation design, thereby producing unbiased estimates of program impacts by subgroup. This method is applied to data from the evaluation of New York State’s Child Assistance Program, a reform that intended to increase work and earnings among welfare recipients. The article interprets the substantive findings and then addresses the advantages and disadvantages of the proposed method.

Suggested Citation

  • Laura R. Peck, 2005. "Using Cluster Analysis in Program Evaluation," Evaluation Review, , vol. 29(2), pages 178-196, April.
    • Handle: RePEc:sae:evarev:v:29:y:2005:i:2:p:178-196
    DOI: 10.1177/0193841X04266335
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0193841X04266335
    Download Restriction: no
    File URL: https://libkey.io/10.1177/0193841X04266335?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Heckman, James, 2001. "Accounting for Heterogeneity, Diversity and General Equilibrium in Evaluating Social Programmes," Economic Journal, Royal Economic Society, vol. 111(475), pages 654-699, November.
    2. James J. Heckman & Jeffrey Smith & Nancy Clements, 1997. "Making The Most Out Of Programme Evaluations and Social Experiments: Accounting For Heterogeneity in Programme Impacts," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 487-535.
    3. James Heckman & Jeffrey Smith & Christopher Taber, 1998. "Accounting For Dropouts In Evaluations Of Social Programs," The Review of Economics and Statistics, MIT Press, vol. 80(1), pages 1-14, February.
    4. Jennifer Hill & Jane Waldfogel & Jeanne Brooks-Gunn, 2002. "Differential effects of high-quality child care," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 21(4), pages 601-627.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Djebbari, Habiba & Smith, Jeffrey, 2008. "Heterogeneous impacts in PROGRESA," Journal of Econometrics, Elsevier, vol. 145(1-2), pages 64-80, July.
    2. Cansino Muñoz-Repiso, José Manuel & Sánchez Braza, Antonio, 2011. "Effectiveness of Public Training Programs Reducing the Time Needed to Find a Job/Eficacia de los programas públicos de formación en la reducción del tiempo necesario para encontrar un empleo," Estudios de Economia Aplicada, Estudios de Economia Aplicada, vol. 29, pages 391(26á.)-3, Abril.
    3. John Mullahy, 2017. "Individual Results May Vary: Elementary Analytics of Inequality-Probability Bounds, with Applications to Health-Outcome Treatment Effects," NBER Working Papers 23603, National Bureau of Economic Research, Inc.
    4. Smith, Jeffrey, 2000. "Evaluation aktiver Arbeitsmarktpolitik : Erfahrungen aus Nordamerika (Evaluating Avtive Labor Market Policies : Lessons from North America)," Mitteilungen aus der Arbeitsmarkt- und Berufsforschung, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany], vol. 33(3), pages 345-356.
    5. Deborah A. Cobb‐Clark & Thomas Crossley, 2003. "Econometrics for Evaluations: An Introduction to Recent Developments," The Economic Record, The Economic Society of Australia, vol. 79(247), pages 491-511, December.
    6. Mullahy, John, 2018. "Individual results may vary: Inequality-probability bounds for some health-outcome treatment effects," Journal of Health Economics, Elsevier, vol. 61(C), pages 151-162.
    7. Burt S. Barnow & Jeffrey Smith, 2015. "Employment and Training Programs," NBER Chapters, in: Economics of Means-Tested Transfer Programs in the United States, Volume 2, pages 127-234, National Bureau of Economic Research, Inc.
    8. Anirban Basu, 2012. "Estimating Person-Centered Treatment (PeT) Effects Using Instrumental Variables," NBER Working Papers 18056, National Bureau of Economic Research, Inc.
    9. Jeffrey Smith, 2000. "A Critical Survey of Empirical Methods for Evaluating Active Labor Market Policies," Swiss Journal of Economics and Statistics (SJES), Swiss Society of Economics and Statistics (SSES), vol. 136(III), pages 247-268, September.
    10. David J. Vanness & John Mullahy, 2012. "Moving Beyond Mean-based Evaluation of Health Care," Chapters, in: Andrew M. Jones (ed.), The Elgar Companion to Health Economics, Second Edition, chapter 52, Edward Elgar Publishing.
    11. Heckman, James J. & Lalonde, Robert J. & Smith, Jeffrey A., 1999. "The economics and econometrics of active labor market programs," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 31, pages 1865-2097, Elsevier.
    12. James J. Heckman & Carolyn Heinrich & Jeffrey Smith, 2002. "The Performance of Performance Standards," Journal of Human Resources, University of Wisconsin Press, vol. 37(4), pages 778-811.
    13. Smith, Jeffrey, 2000. "Evaluation aktiver Arbeitsmarktpolitik : Erfahrungen aus Nordamerika (Evaluating Avtive Labor Market Policies : Lessons from North America)," Mitteilungen aus der Arbeitsmarkt- und Berufsforschung, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany], vol. 33(3), pages 345-356.
    14. Donal O'Neill, 2000. "Evaluating Labour Market Interventions," Economics Department Working Paper Series n990300, Department of Economics, National University of Ireland - Maynooth.
    15. Ozkan Eren & Serkan Ozbeklik, 2014. "Who Benefits From Job Corps? A Distributional Analysis Of An Active Labor Market Program," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 29(4), pages 586-611, June.
    16. Jeff Borland & Yi-Ping Tseng, 2007. "Does a Minimum Job Search Requirement Reduce Time on Unemployment Payments? Evidence from the Jobseeker Diary in Australia," ILR Review, Cornell University, ILR School, vol. 60(3), pages 357-378, April.
    17. Jeff Borland & Yi-Ping Tseng, 2003. "How Do Administrative Arrangements Affect Exit from Unemployment Payments? The Case of the Job Seeker Diary in Australia," Melbourne Institute Working Paper Series wp2003n27, Melbourne Institute of Applied Economic and Social Research, The University of Melbourne.
    18. Michael Lechner, 2002. "Mikroökonometrische Evaluation arbeitsmarktpolitischer Massnahmen," University of St. Gallen Department of Economics working paper series 2002 2002-20, Department of Economics, University of St. Gallen.
    19. Hector Chade & Gustavo Ventura, 1998. "Taxes and Marriage: A Two-Sided Search Analysis," University of Western Ontario, Departmental Research Report Series 9819, University of Western Ontario, Department of Economics.
    20. James J. Heckman, 1991. "Randomization and Social Policy Evaluation Revisited," NBER Technical Working Papers 0107, National Bureau of Economic Research, Inc.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:evarev:v:29:y:2005:i:2:p:178-196. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.