IDEAS home Printed from https://ideas.repec.org/r/bes/jnlasa/v103i484y2008p1334-1344.html
   My bibliography  Save this item

Can Nonrandomized Experiments Yield Accurate Answers? A Randomized Experiment Comparing Random and Nonrandom Assignments

Citations

Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
as


Cited by:

  1. Zhexiao Lin & Peng Ding & Fang Han, 2023. "Estimation Based on Nearest Neighbor Matching: From Density Ratio to Average Treatment Effect," Econometrica, Econometric Society, vol. 91(6), pages 2187-2217, November.
  2. Wunsch, Conny & Strobl, Renate, 2018. "Identification of causal mechanisms based on between-subject double randomization designs," CEPR Discussion Papers 13028, C.E.P.R. Discussion Papers.
  3. Nicholas Voorhees & Justin C. Ortagus & Erica Marti, 2023. "Give It a Swirl? An Examination of the Influence of 4-Year Students Taking Entry-Level Math Courses at the Local Community College," Research in Higher Education, Springer;Association for Institutional Research, vol. 64(1), pages 147-173, February.
  4. Jorgensen, Bjorn N. & Morley, Julia, 2017. "Discussion of “are related party transactions red flags?”," LSE Research Online Documents on Economics 80801, London School of Economics and Political Science, LSE Library.
  5. Masaki, Takaaki, 2016. "Coups d’État and Foreign Aid," World Development, Elsevier, vol. 79(C), pages 51-68.
  6. Kenneth Fortson & Natalya Verbitsky-Savitz & Emma Kopa & Philip Gleason, 2012. "Using an Experimental Evaluation of Charter Schools to Test Whether Nonexperimental Comparison Group Methods Can Replicate Experimental Impact Estimates," Mathematica Policy Research Reports 27f871b5b7b94f3a80278a593, Mathematica Policy Research.
  7. Yasemin Kisbu-Sakarya & Thomas D. Cook & Yang Tang & M. H. Clark, 2018. "Comparative Regression Discontinuity: A Stress Test With Small Samples," Evaluation Review, , vol. 42(1), pages 111-143, February.
  8. repec:mpr:mprres:7443 is not listed on IDEAS
  9. Minhui Zhou & Rachel Murphy & Ran Tao, 2014. "Effects of Parents' Migration on the Education of Children Left Behind in Rural China," Population and Development Review, The Population Council, Inc., vol. 40(2), pages 273-292, June.
  10. Vivian C. Wong & Peter M. Steiner, 2018. "Designs of Empirical Evaluations of Nonexperimental Methods in Field Settings," Evaluation Review, , vol. 42(2), pages 176-213, April.
  11. Dennis A. Kramer & Justin C. Ortagus & T. Austin Lacy, 2018. "Tuition-Setting Authority and Broad-Based Merit Aid: The Effect of Policy Intersection on Pricing Strategies," Research in Higher Education, Springer;Association for Institutional Research, vol. 59(4), pages 489-518, June.
  12. Nan Maxwell & Jeanne Bellotti & Peter Schochet & Paul Burkander & Emilyn Whitesell & Erin Dillon & Hande Inanc & Christian Geckeler & Raquel González, "undated". "Building College and Career Pathways for High School Students: Youth CareerConnect, Impact Findings Report," Mathematica Policy Research Reports 8b75d63f2a684f4d99689de18, Mathematica Policy Research.
  13. Mathur, Maya B & VanderWeele, Tyler, 2021. "Methods to address confounding and other biases in meta-analyses: Review and recommendations," OSF Preprints v7dtq, Center for Open Science.
  14. David M. Rindskopf & William R. Shadish & M. H. Clark, 2018. "Using Bayesian Correspondence Criteria to Compare Results From a Randomized Experiment and a Quasi-Experiment Allowing Self-Selection," Evaluation Review, , vol. 42(2), pages 248-280, April.
  15. Nikolova, Milena & Graham, Carol, 2015. "In transit: The well-being of migrants from transition and post-transition countries," Journal of Economic Behavior & Organization, Elsevier, vol. 112(C), pages 164-186.
  16. Deborah Peikes & Erin Fries Taylor & Stacy Dale & Ann O'Malley & Arkadipta Ghosh & Grace Anglin & Kaylyn Swankoski & Aparajita Zutshi & Lara Converse & Randall Brown, "undated". "Evaluation of the Comprehensive Primary Care Initiative: Second Annual Report," Mathematica Policy Research Reports ba9f7ec1dc504e4abe15302c2, Mathematica Policy Research.
  17. Deborah Peikes & Grace Anglin & Erin Fries Taylor & Stacy Dale & Ann O'Malley & Arkadipta Ghosh & Kaylyn Swankoski & Lara Converse & Rosalind Keith & Mariel Finucane & Jesse Crosson & Anne Mutti & Tho, "undated". "Evaluation of the Comprehensive Primary Care Initiative: Third Annual Report," Mathematica Policy Research Reports 70714de1cb3d4620a5957f68d, Mathematica Policy Research.
  18. Guanglei Hong & Xu Qin & Fan Yang, 2018. "Weighting-Based Sensitivity Analysis in Causal Mediation Studies," Journal of Educational and Behavioral Statistics, , vol. 43(1), pages 32-56, February.
  19. Martin Cousineau & Vedat Verter & Susan A. Murphy & Joelle Pineau, 2022. "Estimating causal effects with optimization-based methods: A review and empirical comparison," Papers 2203.00097, arXiv.org.
  20. Katherine Baicker & Theodore Svoronos, 2019. "Testing the Validity of the Single Interrupted Time Series Design," CID Working Papers 364, Center for International Development at Harvard University.
  21. Andrew P. Jaciw, 2016. "Applications of a Within-Study Comparison Approach for Evaluating Bias in Generalized Causal Inferences From Comparison Groups Studies," Evaluation Review, , vol. 40(3), pages 241-276, June.
  22. Akanksha Negi, 2020. "Doubly weighted M-estimation for nonrandom assignment and missing outcomes," Papers 2011.11485, arXiv.org.
  23. Rezaei, Ehsan Eyshi & Gaiser, Thomas, 2017. "Change in crop management strategies could double the maize yield in Africa," Discussion Papers 260154, University of Bonn, Center for Development Research (ZEF).
  24. Peter M. Steiner & Thomas D. Cook & William R. Shadish, 2011. "On the Importance of Reliable Covariate Measurement in Selection Bias Adjustments Using Propensity Scores," Journal of Educational and Behavioral Statistics, , vol. 36(2), pages 213-236, April.
  25. Lechner, Michael & Wunsch, Conny, 2013. "Sensitivity of matching-based program evaluations to the availability of control variables," Labour Economics, Elsevier, vol. 21(C), pages 111-121.
  26. Ferraro, Paul J. & Miranda, Juan José, 2014. "The performance of non-experimental designs in the evaluation of environmental programs: A design-replication study using a large-scale randomized experiment as a benchmark," Journal of Economic Behavior & Organization, Elsevier, vol. 107(PA), pages 344-365.
  27. Aloyce R. Kaliba & Anne G. Gongwe & Kizito Mazvimavi & Ashagre Yigletu, 2021. "Impact of Adopting Improved Seeds on Access to Broader Food Groups Among Small-Scale Sorghum Producers in Tanzania," SAGE Open, , vol. 11(1), pages 21582440209, January.
  28. Hoang, Anh Tuan & Sandro Nižetić, & Olcer, Aykut I. & Ong, Hwai Chyuan & Chen, Wei-Hsin & Chong, Cheng Tung & Thomas, Sabu & Bandh, Suhaib A. & Nguyen, Xuan Phuong, 2021. "Impacts of COVID-19 pandemic on the global energy system and the shift progress to renewable energy: Opportunities, challenges, and policy implications," Energy Policy, Elsevier, vol. 154(C).
  29. K. C. Culver & Nicholas A. Bowman, 2020. "Is What Glitters Really Gold? A Quasi-Experimental Study of First-Year Seminars and College Student Success," Research in Higher Education, Springer;Association for Institutional Research, vol. 61(2), pages 167-196, March.
  30. Vannieuwenhuyze, Jorre T.A. & Lynn, Peter, 2014. "Measurement effects between CAPI and Web questionnaires in the UK Household Longitudinal Study," Understanding Society Working Paper Series 2014-01, Understanding Society at the Institute for Social and Economic Research.
  31. Jessica Saunders & Layla Parast & Susan H Babey & Jeremy V Miles, 2017. "Exploring the differences between pet and non-pet owners: Implications for human-animal interaction research and policy," PLOS ONE, Public Library of Science, vol. 12(6), pages 1-15, June.
  32. Gary T. Henry & Kevin C. Bastian & C. Kevin Fortner & David C. Kershaw & Kelly M. Purtell & Charles L. Thompson & Rebecca A. Zulli, 2014. "Teacher Preparation Policies and Their Effects on Student Achievement," Education Finance and Policy, MIT Press, vol. 9(3), pages 264-303, July.
  33. Goldberg, Matthew H., 2019. "How often does random assignment fail? Estimates and recommendations," OSF Preprints s2j4r, Center for Open Science.
  34. Legewie, Joscha & DiPrete, Thomas A., 2014. "The High School Environment and the Gender Gap in Science and Engineering," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 87(4), pages 259-280.
  35. Ainembabazi, John Herbert & Abdoulaye, Tahirou & Feleke, Shiferaw & Alene, Arega & Dontsop-Nguezet, Paul M. & Ndayisaba, Pierre Celestin & Hicintuka, Cyrille & Mapatano, Sylvain & Manyong, Victor, 2018. "Who benefits from which agricultural research-for-development technologies? Evidence from farm household poverty analysis in Central Africa," World Development, Elsevier, vol. 108(C), pages 28-46.
  36. Vivian C. Wong & Peter M. Steiner & Kylie L. Anglin, 2018. "What Can Be Learned From Empirical Evaluations of Nonexperimental Methods?," Evaluation Review, , vol. 42(2), pages 147-175, April.
  37. Colin Cannonier, 2009. "State Abstinence Education Programs and Teen Fertility in the U.S," Departmental Working Papers 2009-14, Department of Economics, Louisiana State University.
  38. George C. Galster & Anna Maria Santiago & Richard J. Smith & Joffre Leroux, 2019. "Benefit–Cost Analysis of an Innovative Program for Self-Sufficiency and Homeownership," Evaluation Review, , vol. 43(1-2), pages 3-40, February.
  39. Peter M. Steiner, 2011. "Propensity Score Methods for Causal Inference: On the Relative Importance of Covariate Selection, Reliable Measurement, and Choice of Propensity Score Technique," Working Papers 09, AlmaLaurea Inter-University Consortium.
  40. Fortson, Kenneth & Gleason, Philip & Kopa, Emma & Verbitsky-Savitz, Natalya, 2015. "Horseshoes, hand grenades, and treatment effects? Reassessing whether nonexperimental estimators are biased," Economics of Education Review, Elsevier, vol. 44(C), pages 100-113.
  41. Xiang Zhou & Yu Xie, 2016. "Propensity Score–based Methods Versus MTE-based Methods in Causal Inference," Sociological Methods & Research, , vol. 45(1), pages 3-40, February.
  42. Joscha Legewie, 2018. "Living on the Edge: Neighborhood Boundaries and the Spatial Dynamics of Violent Crime," Demography, Springer;Population Association of America (PAA), vol. 55(5), pages 1957-1977, October.
  43. Laura Contalbrigo & Marta De Santis & Marica Toson & Maria Montanaro & Luca Farina & Aldo Costa & Felice Alfonso Nava, 2017. "The Efficacy of Dog Assisted Therapy in Detained Drug Users: A Pilot Study in an Italian Attenuated Custody Institute," IJERPH, MDPI, vol. 14(7), pages 1-16, June.
  44. Onur Altindag & Theodore J. Joyce & Julie A. Reeder, 2019. "Can Nonexperimental Methods Provide Unbiased Estimates of a Breastfeeding Intervention? A Within-Study Comparison of Peer Counseling in Oregon," Evaluation Review, , vol. 43(3-4), pages 152-188, June.
  45. Samantha Marie Schenck, 2021. "Assessing the Employment Effects of California’s Paid Family Leave Program," Eastern Economic Journal, Palgrave Macmillan;Eastern Economic Association, vol. 47(3), pages 406-429, June.
  46. Peter M. Steiner & Vivian C. Wong, 2018. "Assessing Correspondence Between Experimental and Nonexperimental Estimates in Within-Study Comparisons," Evaluation Review, , vol. 42(2), pages 214-247, April.
  47. Brian Goesling & Joanne Lee, 2015. "Improving the Rigor of Quasi-Experimental Impact Evaluations: Lessons for Teen Pregnancy Prevention Researchers," Mathematica Policy Research Reports f4f8b24cbf874a3989d87cf89, Mathematica Policy Research.
  48. Kenneth Fortson & Philip Gleason & Emma Kopa & Natalya Verbitsky-Savitz, "undated". "Horseshoes, Hand Grenades, and Treatment Effects? Reassessing Bias in Nonexperimental Estimators," Mathematica Policy Research Reports 1c24988cd5454dd3be51fbc2c, Mathematica Policy Research.
  49. Jean Stockard, 2013. "Merging the accountability and scientific research requirements of the No Child Left Behind Act: using cohort control groups," Quality & Quantity: International Journal of Methodology, Springer, vol. 47(4), pages 2225-2257, June.
  50. Anna Haskins, 2013. "Mass Imprisonment and the Intergenerational Transmission of Disadvantage: Paternal Incarceration and Children’s Cognitive Skill Development," Working Papers wp13-15-ff, Princeton University, School of Public and International Affairs, Center for Research on Child Wellbeing..
  51. Gregory C. Wolniak & Marjolein Muskens, 2021. "Undermatching and Noncognitive Development during the First Year of College: A Longitudinal Study of College Students in the Netherlands," Research in Higher Education, Springer;Association for Institutional Research, vol. 62(6), pages 855-884, September.
  52. Michael Broda & Eric Ekholm & Barbara Schneider & Amy C. Hutton, 2018. "Teachers’ Social Networks, College-Going Practices, and the Diffusion of a School-Based Reform Initiative," SAGE Open, , vol. 8(4), pages 21582440188, December.
  53. Ben Weidmann & Luke Miratrix, 2021. "Lurking Inferential Monsters? Quantifying Selection Bias In Evaluations Of School Programs," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 40(3), pages 964-986, June.
  54. Heissel, Jennifer, 2016. "The relative benefits of live versus online delivery: Evidence from virtual algebra I in North Carolina," Economics of Education Review, Elsevier, vol. 53(C), pages 99-115.
  55. Jordan H. Rickles, 2011. "Using Interviews to Understand the Assignment Mechanism in a Nonexperimental Study," Evaluation Review, , vol. 35(5), pages 490-522, October.
  56. Paul Burkander & Nan Maxwell & Menbere Shiferaw & Matt Jacobus & Alma Vigil & Charles Tilley & Alicia Harrington & Erin Dillon & Hande Inanc & Peter Schochet, "undated". "Building College and Career Pathways for High School Students: Youth CareerConnect, Technical Report for the Impact Study," Mathematica Policy Research Reports c0b91a97d65342eb82cf8eb7f, Mathematica Policy Research.
  57. Ana Kolar & Peter M. Steiner, 2021. "The Role of Sample Size to Attain Statistically Comparable Groups – A Required Data Preprocessing Step to Estimate Causal Effects With Observational Data," Evaluation Review, , vol. 45(5), pages 195-227, October.
  58. Terri J. Sabol & Robert C. Pianta, 2014. "Do Standard Measures of Preschool Quality Used in Statewide Policy Predict School Readiness?," Education Finance and Policy, MIT Press, vol. 9(2), pages 116-164, March.
  59. Kari Lock Morgan & Donald B. Rubin, 2015. "Rerandomization to Balance Tiers of Covariates," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(512), pages 1412-1421, December.
  60. Justin C. Ortagus, 2018. "National Evidence of the Impact of First-Year Online Enrollment on Postsecondary Students’ Long-Term Academic Outcomes," Research in Higher Education, Springer;Association for Institutional Research, vol. 59(8), pages 1035-1058, December.
  61. Andrew P. Jaciw, 2016. "Assessing the Accuracy of Generalized Inferences From Comparison Group Studies Using a Within-Study Comparison Approach," Evaluation Review, , vol. 40(3), pages 199-240, June.
  62. Youmi Suk & Hyunseung Kang, 2022. "Robust Machine Learning for Treatment Effects in Multilevel Observational Studies Under Cluster-level Unmeasured Confounding," Psychometrika, Springer;The Psychometric Society, vol. 87(1), pages 310-343, March.
  63. Zhang, Fangni & Graham, Daniel J. & Wong, Mark Siu Chun, 2018. "Quantifying the substitutability and complementarity between high-speed rail and air transport," Transportation Research Part A: Policy and Practice, Elsevier, vol. 118(C), pages 191-215.
  64. Hansjoerg Gaus & Christoph Emanuel Mueller, 2011. "Evaluating Free-Choice Climate Education Interventions Applying Propensity Score Matching," Evaluation Review, , vol. 35(6), pages 673-722, December.
  65. Katherine Baicker & Theodore Svoronos, 2019. "Testing the Validity of the Single Interrupted Time Series Design," NBER Working Papers 26080, National Bureau of Economic Research, Inc.
  66. Jordan H. Rickles & Michael Seltzer, 2014. "A Two-Stage Propensity Score Matching Strategy for Treatment Effect Estimation in a Multisite Observational Study," Journal of Educational and Behavioral Statistics, , vol. 39(6), pages 612-636, December.
  67. Ethan J. Raker, 2020. "Natural Hazards, Disasters, and Demographic Change: The Case of Severe Tornadoes in the United States, 1980–2010," Demography, Springer;Population Association of America (PAA), vol. 57(2), pages 653-674, April.
  68. David M. Brasington, 2023. "The effect of open space maintenance spending on house prices," Journal of Regional Science, Wiley Blackwell, vol. 63(5), pages 1053-1072, November.
  69. Xiaokang Luo & Tirthankar Dasgupta & Minge Xie & Regina Y. Liu, 2021. "Leveraging the Fisher randomization test using confidence distributions: Inference, combination and fusion learning," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 83(4), pages 777-797, September.
  70. Cousineau, Martin & Verter, Vedat & Murphy, Susan A. & Pineau, Joelle, 2023. "Estimating causal effects with optimization-based methods: A review and empirical comparison," European Journal of Operational Research, Elsevier, vol. 304(2), pages 367-380.
IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.