External Validity: The Next Step for Systematic Reviews?
Author
Abstract
Suggested Citation
DOI: 10.1177/0193841X16665199
Download full text from publisher
References listed on IDEAS
- Marianne P. Bitler & Jonah B. Gelbach & Hilary W. Hoynes, 2006.
"What Mean Impacts Miss: Distributional Effects of Welfare Reform Experiments,"
American Economic Review, American Economic Association, vol. 96(4), pages 988-1012, September.
- Marianne Bitler & Jonah Gelbach & Hilary Hoynes, 2003. "What Mean Impacts Miss: Distributional Effects of Welfare Reform Experiments," NBER Working Papers 10121, National Bureau of Economic Research, Inc.
- Marianne P. Bitler & Jonah Gelbach & Hilary Hoynes, 2004. "What Mean Impacts Miss Distributional Effects of Welfare Reform Experiments," Working Papers WR-109-NICHD/NIA, RAND Corporation.
- Hilary W. Hoynes & Marianne P Bitler & Jonah Gelbach, 2005. "What Mean Impacts Miss:Distributional Effects of Welfare Reform Experiments," Working Papers 36, University of California, Davis, Department of Economics.
- Bitler, Marianne P. & Gelbach, Jonah B. & Hoynes, Hilary W., 2005. "What Mean Impacts Miss: Distributional Effects of Welfare Reform Experiments," IZA Discussion Papers 1728, Institute of Labor Economics (IZA).
- Robert B. Olsen & Larry L. Orr & Stephen H. Bell & Elizabeth A. Stuart, 2013. "External Validity in Policy Evaluations That Choose Sites Purposively," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 32(1), pages 107-121, January.
- Kenneth F Schulz & Douglas G Altman & David Moher & for the CONSORT Group, 2010. "CONSORT 2010 Statement: Updated Guidelines for Reporting Parallel Group Randomised Trials," PLOS Medicine, Public Library of Science, vol. 7(3), pages 1-7, March.
- Steckler, A. & McLeroy, K.R., 2008. "The importance of external validity," American Journal of Public Health, American Public Health Association, vol. 98(1), pages 9-10.
- repec:mpr:mprres:6574 is not listed on IDEAS
- Chen, Huey T., 2010. "The bottom-up approach to integrative validity: A new perspective for program evaluation," Evaluation and Program Planning, Elsevier, vol. 33(3), pages 205-214, August.
- Paulsell, D. & Del Grosso, P. & Supplee, L., 2014. "Supporting replication and scale-up of evidence-based home visiting programs: Assessing the implementation knowledge base," American Journal of Public Health, American Public Health Association, vol. 104(9), pages 1624-1632.
- Elizabeth A. Stuart & Stephen R. Cole & Catherine P. Bradshaw & Philip J. Leaf, 2011. "The use of propensity scores to assess the generalizability of results from randomized trials," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 174(2), pages 369-386, April.
- Changyu Shen & Jaesik Jeong & Xiaochun Li & Peng-Sheng Chen & Alfred Buxton, 2013. "Treatment Benefit and Treatment Harm Rate to Characterize Heterogeneity in Treatment Effect," Biometrics, The International Biometric Society, vol. 69(3), pages 724-731, September.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
Cited by:
- Christian Leuz, 2018.
"Evidence-based policymaking: promise, challenges and opportunities for accounting and financial markets research,"
Accounting and Business Research, Taylor & Francis Journals, vol. 48(5), pages 582-608, July.
- Leuz, Christian, 2018. "Evidence-based policymaking: Promise, challenges and opportunities for accounting and financial markets research," CFS Working Paper Series 611, Center for Financial Studies (CFS).
- Christian Leuz, 2018. "Evidence-Based Policymaking: Promise, Challenges and Opportunities for Accounting and Financial Markets Research," NBER Working Papers 24535, National Bureau of Economic Research, Inc.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Jacob Alex Klerman, 2017. "Editor in Chief’s Comment: External Validity in Systematic Reviews," Evaluation Review, , vol. 41(5), pages 391-402, October.
- repec:mpr:mprres:8128 is not listed on IDEAS
- Jörg Peters & Jörg Langbein & Gareth Roberts, 2018.
"Generalization in the Tropics – Development Policy, Randomized Controlled Trials, and External Validity,"
The World Bank Research Observer, World Bank, vol. 33(1), pages 34-64.
- Peters, Jörg & Langbein, Jörg & Roberts, Gareth, 2017. "Generalization in the Tropics: Development policy, randomized controlled trials, and external validity," Ruhr Economic Papers 716, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
- Sharples, Linda D., 2018. "The role of statistics in the era of big data: Electronic health records for healthcare research," Statistics & Probability Letters, Elsevier, vol. 136(C), pages 105-110.
- Elizabeth A. Stuart & Anna Rhodes, 2017. "Generalizing Treatment Effect Estimates From Sample to Population: A Case Study in the Difficulties of Finding Sufficient Data," Evaluation Review, , vol. 41(4), pages 357-388, August.
- Elizabeth Tipton, 2021. "Beyond generalization of the ATE: Designing randomized trials to understand treatment effect heterogeneity," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 184(2), pages 504-521, April.
- Rajeev Dehejia & Cristian Pop-Eleches & Cyrus Samii, 2021.
"From Local to Global: External Validity in a Fertility Natural Experiment,"
Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(1), pages 217-243, January.
- Dehejia, Rajeev & Pop-Eleches, Cristian & Samii, Cyrus, 2015. "From Local to Global: External Validity in a Fertility Natural Experiment," IZA Discussion Papers 9300, Institute of Labor Economics (IZA).
- Rajeev H. Dehejia & Cristian Pop-Eleches & Cyrus Samii, 2015. "From Local to Global: External Validity in a Fertility Natural Experiment," CESifo Working Paper Series 5493, CESifo.
- Rajeev Dehejia & Cristian Pop-Eleches & Cyrus Samii, 2019. "From Local to Global: External Validity in a Fertility Natural Experiment," Papers 1906.08096, arXiv.org.
- Rajeev Dehejia & Cristian Pop-Eleches & Cyrus Samii, 2015. "From Local to Global: External Validity in a Fertility Natural Experiment," NBER Working Papers 21459, National Bureau of Economic Research, Inc.
- Peter Z. Schochet, "undated". "Statistical Theory for the RCT-YES Software: Design-Based Causal Inference for RCTs," Mathematica Policy Research Reports a0c005c003c242308a92c02dc, Mathematica Policy Research.
- Xinkun Nie & Guido Imbens & Stefan Wager, 2021. "Covariate Balancing Sensitivity Analysis for Extrapolating Randomized Trials across Locations," Papers 2112.04723, arXiv.org.
- Wendy Chan, 2018. "Applications of Small Area Estimation to Generalization With Subclassification by Propensity Scores," Journal of Educational and Behavioral Statistics, , vol. 43(2), pages 182-224, April.
- Elizabeth Tipton & Kelly Hallberg & Larry V. Hedges & Wendy Chan, 2017. "Implications of Small Samples for Generalization: Adjustments and Rules of Thumb," Evaluation Review, , vol. 41(5), pages 472-505, October.
- Diane Paulsell & Jaime Thomas & Shannon Monahan & Neil S. Seftor, 2017. "A Trusted Source of Information," Evaluation Review, , vol. 41(1), pages 50-77, February.
- Esterling, Kevin & Brady, David & Schwitzgebel, Eric, 2021. "The Necessity of Construct and External Validity for Generalized Causal Claims," OSF Preprints 2s8w5, Center for Open Science.
- Chen, Huey T. & Yip, Fuyuen & Lavonas, Eric J. & Iqbal, Shahed & Turner, Nannette & Cobb, Bobby & Garbe, Paul, 2014. "Using the exhibited generalization approach to evaluate a carbon monoxide alarm ordinance," Evaluation and Program Planning, Elsevier, vol. 47(C), pages 35-44.
- Andrews, Isaiah & Oster, Emily, 2019. "A simple approximation for evaluating external validity bias," Economics Letters, Elsevier, vol. 178(C), pages 58-62.
- Elizabeth Tipton & Laura R. Peck, 2017. "A Design-Based Approach to Improve External Validity in Welfare Policy Evaluations," Evaluation Review, , vol. 41(4), pages 326-356, August.
- Deaton, Angus & Cartwright, Nancy, 2018.
"Understanding and misunderstanding randomized controlled trials,"
Social Science & Medicine, Elsevier, vol. 210(C), pages 2-21.
- Angus Deaton & Nancy Cartwright, 2016. "Understanding and Misunderstanding Randomized Controlled Trials," NBER Working Papers 22595, National Bureau of Economic Research, Inc.
- Angus Deaton & Nancy Cartwright, 2017. "Understanding and misunderstanding randomized controlled trials," Working Papers 2017-10, Princeton University, Woodrow Wilson School of Public and International Affairs, Center for Health and Wellbeing..
- Angus Deaton & Nancy Cartwright, 2016. "Understanding and Misunderstanding Randomized Controlled Trials," Working Papers august_25.pdf, Princeton University, Woodrow Wilson School of Public and International Affairs, Research Program in Development Studies..
- Elizabeth Tipton, 2014. "How Generalizable Is Your Experiment? An Index for Comparing Experimental Samples and Populations," Journal of Educational and Behavioral Statistics, , vol. 39(6), pages 478-501, December.
- Fabian Kosse & Thomas Deckers & Pia Pinger & Hannah Schildberg-Hörisch & Armin Falk, 2020.
"The Formation of Prosociality: Causal Evidence on the Role of Social Environment,"
Journal of Political Economy, University of Chicago Press, vol. 128(2), pages 434-467.
- Fabian Kosse & Thomas Deckers & Hannah Schildberg-Horisch & Armin Falk, 2016. "The Formation of Prosociality: Causal Evidence on the Role of Social Environment," Working Papers 2016-011, Human Capital and Economic Opportunity Working Group.
- Fabian Kosse & Thomas Deckers & Pia Pinger & Hannah Schildberg-Hörisch & Armin Falk, 2018. "The Formation of Prosociality: Causal Evidence on the Role of Social Environment," CESifo Working Paper Series 7068, CESifo.
- Kosse, Fabian & Deckers, Thomas & Schildberg-Hörisch, Hannah & Falk, Armin, 2017. "The formation of prosociality: Causal evidence on the role of social environment," DICE Discussion Papers 266, Heinrich Heine University Düsseldorf, Düsseldorf Institute for Competition Economics (DICE).
- Fabian Kosse & Thomas Deckers & Hannah Schildberg-Hörisch & Armin Falk, 2016. "The Formation of Prosociality: Causal Evidence on the Role of Social Environment," SOEPpapers on Multidisciplinary Panel Data Research 840, DIW Berlin, The German Socio-Economic Panel (SOEP).
- Fabian Kosse & Thomas Deckers & Pia Pinger & Hannah Schildberg-Horisch & Armin Falk, 2018. "The Formation of Prosociality: Causal Evidence on the Role of Social Environment," Working Papers 2018-025, Human Capital and Economic Opportunity Working Group.
- Kosse, Fabian & Deckers, Thomas & Pinger, Pia & Schildberg-Hörisch, Hannah & Falk, Armin, 2019. "The Formation of Prosociality: Causal Evidence on the Role of Social Environment," Rationality and Competition Discussion Paper Series 167, CRC TRR 190 Rationality and Competition.
- Kosse, Fabian & Deckers, Thomas & Pinger, Pia & Schildberg-Hoerisch, Hannah & Falk, Armin, 2020. "The Formation of Prosociality: Causal Evidence on the Role of Social Environment," Munich Reprints in Economics 84772, University of Munich, Department of Economics.
- Fabian Kosse & Thomas Deckers & Pia Pinger & Hannah Schildberg-Hörisch & Armin Falk, 2018. "The Formation of Prosociality: Causal Evidence on the Role of Social Environment," CRC TR 224 Discussion Paper Series crctr224_2018_013, University of Bonn and University of Mannheim, Germany.
- Kosse, Fabian & Deckers, Thomas & Schildberg-Hörisch, Hannah & Falk, Armin, 2016. "The Formation of Prosociality: Causal Evidence on the Role of Social Environment," IZA Discussion Papers 9861, Institute of Labor Economics (IZA).
- Ángel Enrique & Juana Bretón-López & Guadalupe Molinari & Rosa M. Baños & Cristina Botella, 2018. "Efficacy of an adaptation of the Best Possible Self intervention implemented through positive technology: a randomized control trial," Applied Research in Quality of Life, Springer;International Society for Quality-of-Life Studies, vol. 13(3), pages 671-689, September.
- Gerben ter Riet & Paula Chesley & Alan G Gross & Lara Siebeling & Patrick Muggensturm & Nadine Heller & Martin Umbehr & Daniela Vollenweider & Tsung Yu & Elie A Akl & Lizzy Brewster & Olaf M Dekkers &, 2013. "All That Glitters Isn't Gold: A Survey on Acknowledgment of Limitations in Biomedical Studies," PLOS ONE, Public Library of Science, vol. 8(11), pages 1-6, November.
More about this item
Keywords
external validity; systematic reviews;Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:evarev:v:41:y:2017:i:4:p:283-325. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.