A simple approximation for evaluating external validity bias
Author
Abstract
Suggested Citation
DOI: 10.1016/j.econlet.2019.02.020
Download full text from publisher
As the access to this document is restricted, you may want to search for a different version of it.
References listed on IDEAS
- Rajeev Dehejia & Cristian Pop-Eleches & Cyrus Samii, 2021.
"From Local to Global: External Validity in a Fertility Natural Experiment,"
Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(1), pages 217-243, January.
- Dehejia, Rajeev & Pop-Eleches, Cristian & Samii, Cyrus, 2015. "From Local to Global: External Validity in a Fertility Natural Experiment," IZA Discussion Papers 9300, Institute of Labor Economics (IZA).
- Rajeev H. Dehejia & Cristian Pop-Eleches & Cyrus Samii, 2015. "From Local to Global: External Validity in a Fertility Natural Experiment," CESifo Working Paper Series 5493, CESifo.
- Rajeev Dehejia & Cristian Pop-Eleches & Cyrus Samii, 2019. "From Local to Global: External Validity in a Fertility Natural Experiment," Papers 1906.08096, arXiv.org.
- Rajeev Dehejia & Cristian Pop-Eleches & Cyrus Samii, 2015. "From Local to Global: External Validity in a Fertility Natural Experiment," NBER Working Papers 21459, National Bureau of Economic Research, Inc.
- Robert B. Olsen & Larry L. Orr & Stephen H. Bell & Elizabeth A. Stuart, 2013. "External Validity in Policy Evaluations That Choose Sites Purposively," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 32(1), pages 107-121, January.
- Nicholas Bloom & James Liang & John Roberts & Zhichun Jenny Ying, 2015.
"Does Working from Home Work? Evidence from a Chinese Experiment,"
The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 130(1), pages 165-218.
- Bloom, Nicholas & Liang, James & Roberts, John & Ying, Zhichun Jenny, 2013. "Does working from home work? Evidence from a Chinese experiment," LSE Research Online Documents on Economics 51525, London School of Economics and Political Science, LSE Library.
- Nicholas Bloom & James Liang & John Roberts & Zhichun Jenny Ying, 2013. "Does Working from Home Work? Evidence from a Chinese Experiment," CEP Discussion Papers dp1194, Centre for Economic Performance, LSE.
- Nicholas Bloom & James Liang & John Roberts & Zhichun Jenny Ying, 2013. "Does Working from Home Work? Evidence from a Chinese Experiment," NBER Working Papers 18871, National Bureau of Economic Research, Inc.
- Hunt Allcott, 2015. "Site Selection Bias in Program Evaluation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 130(3), pages 1117-1165.
- Karthik Muralidharan & Abhijeet Singh & Alejandro J. Ganimian, 2019.
"Disrupting Education? Experimental Evidence on Technology-Aided Instruction in India,"
American Economic Review, American Economic Association, vol. 109(4), pages 1426-1460, April.
- Muralidharan, K. & Singh, A. & Ganimian, A. J., 2016. "Disrupting education? Experimental evidence on technology-aided instruction in India," Working Paper 467377, Harvard University OpenScholar.
- Karthik Muralidharan & Abhijeet Singh & Alejandro J. Ganimian, 2017. "Disrupting Education? Experimental Evidence on Technology-Aided Instruction in India," CESifo Working Paper Series 6328, CESifo.
- Karthik Muralidharan & Abhijeet Singh & Alejandro J. Ganimian, 2016. "Disrupting Education? Experimental Evidence on Technology-Aided Instruction in India," NBER Working Papers 22923, National Bureau of Economic Research, Inc.
- Eva Vivalt, 0. "How Much Can We Generalize From Impact Evaluations?," Journal of the European Economic Association, European Economic Association, vol. 18(6), pages 3045-3089.
- James J. Heckman & Sergio Urzua & Edward Vytlacil, 2006.
"Understanding Instrumental Variables in Models with Essential Heterogeneity,"
The Review of Economics and Statistics, MIT Press, vol. 88(3), pages 389-432, August.
- James J. Heckman & Sergio Urzua & Edward J. Vytlacil, 2006. "Understanding Instrumental Variables in Models with Essential Heterogeneity," NBER Working Papers 12574, National Bureau of Economic Research, Inc.
- James J. Heckman & Sergio Urzua & Edward Vytlacil, 2009. "Understanding Instrumental Variables in Models with Essential Heterogeneity," Working Papers 200941, Geary Institute, University College Dublin.
- Heckman, James J. & Urzua, Sergio & Vytlacil, Edward, 2006. "Understanding Instrumental Variables in Models with Essential Heterogeneity," IZA Discussion Papers 2320, Institute of Labor Economics (IZA).
- George J. Borjas, 2021.
"Self-Selection and the Earnings of Immigrants,"
World Scientific Book Chapters, in: Foundational Essays in Immigration Economics, chapter 4, pages 69-91,
World Scientific Publishing Co. Pte. Ltd..
- Borjas, George J, 1987. "Self-Selection and the Earnings of Immigrants," American Economic Review, American Economic Association, vol. 77(4), pages 531-553, September.
- George J. Borjas, 1987. "Self-Selection and the Earnings of Immigrants," NBER Working Papers 2248, National Bureau of Economic Research, Inc.
- Alexander Gelber & Adam Isen & Judd B. Kessler, 2016. "The Effects of Youth Employment: Evidence from New York City Lotteries," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(1), pages 423-460.
- Orazio Attanasio & Adriana Kugler & Costas Meghir, 2011. "Subsidizing Vocational Training for Disadvantaged Youth in Colombia: Evidence from a Randomized Trial," American Economic Journal: Applied Economics, American Economic Association, vol. 3(3), pages 188-220, July.
- Rachael Meager, 2019. "Understanding the Average Impact of Microcredit Expansions: A Bayesian Hierarchical Analysis of Seven Randomized Experiments," American Economic Journal: Applied Economics, American Economic Association, vol. 11(1), pages 57-91, January.
- Elizabeth A. Stuart & Stephen R. Cole & Catherine P. Bradshaw & Philip J. Leaf, 2011. "The use of propensity scores to assess the generalizability of results from randomized trials," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 174(2), pages 369-386, April.
- Meager, Rachael, 2019. "Understanding the average impact of microcredit expansions: a Bayesian hierarchical analysis of seven randomized experiments," LSE Research Online Documents on Economics 88190, London School of Economics and Political Science, LSE Library.
- Joseph Hotz, V. & Imbens, Guido W. & Mortimer, Julie H., 2005. "Predicting the efficacy of future training programs using past experiences at other locations," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 241-270.
- Karthik Muralidharan & Venkatesh Sundararaman, 2011.
"Teacher Performance Pay: Experimental Evidence from India,"
Journal of Political Economy, University of Chicago Press, vol. 119(1), pages 39-77.
- Karthik Muralidharan & Venkatesh Sundararaman, 2009. "Teacher Performance Pay: Experimental Evidence from India," NBER Working Papers 15323, National Bureau of Economic Research, Inc.
- Benjamin A. Olken & Junko Onishi & Susan Wong, 2014. "Should Aid Reward Performance? Evidence from a Field Experiment on Health and Education in Indonesia," American Economic Journal: Applied Economics, American Economic Association, vol. 6(4), pages 1-34, October.
- Imbens,Guido W. & Rubin,Donald B., 2015. "Causal Inference for Statistics, Social, and Biomedical Sciences," Cambridge Books, Cambridge University Press, number 9780521885881, January.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
Cited by:
- Dalia Ghanem & Sarojini Hirshleifer & Karen Ortiz-Becerra, 2019.
"Testing Attrition Bias in Field Experiments,"
Working Papers
202218, University of California at Riverside, Department of Economics, revised Oct 2022.
- Ghanem, Dalia & Hirshleifer, Sarojini & Ortiz-Becerra, Karen, 2019. "Testing Attrition Bias in Field Experiments," 2019 Annual Meeting, July 21-23, Atlanta, Georgia 291215, Agricultural and Applied Economics Association.
- Dalia Ghanem & Sarojini Hirshleifer & Karen Ortiz-Becerra, 2019. "Testing for Attrition Bias in Field Experiments," Working Papers 202010, University of California at Riverside, Department of Economics, revised Mar 2020.
- Karen Ortiz-Becerra, 2022. "Testing attrition bias in field experiments," Economics Virtual Symposium 2022 08, Stata Users Group.
- Thomas Fujiwara & Karsten Müller & Carlo Schwarz, 2024.
"The Effect of Social Media on Elections: Evidence from The United States,"
Journal of the European Economic Association, European Economic Association, vol. 22(3), pages 1495-1539.
- Thomas Fujiwara & Karsten Müller & Carlo Schwarz, 2021. "The Effect of Social Media on Elections: Evidence from the United States," NBER Working Papers 28849, National Bureau of Economic Research, Inc.
- Fujiwara, Thomas & Muller, Karsten & Schwarz, Carlo, 2024. "The Effect of Social Media on Elections: Evidence from the United States," CAGE Online Working Paper Series 700, Competitive Advantage in the Global Economy (CAGE).
- Thomas Fujiwara & Karsten Müller & Carlo Schwarz, 2022. "The Effect of Social Media on Elections: Evidence from the United States," Working Papers 2022-18, Princeton University. Economics Department..
- Takuya Ishihara & Toru Kitagawa, 2021. "Evidence Aggregation for Treatment Choice," Papers 2108.06473, arXiv.org, revised Jul 2024.
- Thomas Fujiwara & Karsten Müller & Carlo Schwarz, 2021.
"The Effect of Social Media on Elections: Evidence from the United States,"
NBER Working Papers
28849, National Bureau of Economic Research, Inc.
- Thomas Fujiwara & Karsten Müller & Carlo Schwarz, 2021. "The Effect of Social Media on Elections: Evidence from the United States," Working Papers 2021-53, Princeton University. Economics Department..
- Colnet Bénédicte & Josse Julie & Varoquaux Gaël & Scornet Erwan, 2022. "Causal effect on a target population: A sensitivity analysis to handle missing covariates," Journal of Causal Inference, De Gruyter, vol. 10(1), pages 372-414, January.
- Dalia Ghanem & Sarojini Hirshleifer & Karen Ortiz-Becerra, 2019.
"Testing for Attrition Bias in Field Experiments,"
Working Papers
202010, University of California at Riverside, Department of Economics, revised Mar 2020.
- Sarojini Hirshleifer & Dalia Ghanem & Karen Ortiz-Becerra, 2019. "Testing for Attrition Bias in Field Experiments," Working Papers 201919, University of California at Riverside, Department of Economics, revised Aug 2019.
- Sebastian Gallegos & Pablo Celhay, 2020. "Early Skill Effects on Types of Parental Investments and Long-Run Outcomes," Working Papers 2020-014, Human Capital and Economic Opportunity Working Group.
- Susan Athey & Raj Chetty & Guido W. Imbens & Hyunseung Kang, 2019. "The Surrogate Index: Combining Short-Term Proxies to Estimate Long-Term Treatment Effects More Rapidly and Precisely," NBER Working Papers 26463, National Bureau of Economic Research, Inc.
- Daido Kido, 2022. "Distributionally Robust Policy Learning with Wasserstein Distance," Papers 2205.04637, arXiv.org, revised Aug 2022.
- Galiani, Sebastian & Quistorff, Brian, 2024.
"Assessing external validity in practice,"
Research in Economics, Elsevier, vol. 78(3).
- Sebastian Galiani & Brian Quistorff, 2022. "Assessing External Validity in Practice," NBER Working Papers 30398, National Bureau of Economic Research, Inc.
- Naoki Egami & Erin Hartman, 2021. "Covariate selection for generalizing experimental results: Application to a large‐scale development program in Uganda," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 184(4), pages 1524-1548, October.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Isaiah Andrews & Emily Oster, 2017. "A Simple Approximation for Evaluating External Validity Bias," NBER Working Papers 23826, National Bureau of Economic Research, Inc.
- Denis Fougère & Nicolas Jacquemet, 2020.
"Policy Evaluation Using Causal Inference Methods,"
SciencePo Working papers Main
hal-03455978, HAL.
- Denis Fougère & Nicolas Jacquemet, 2020. "Policy Evaluation Using Causal Inference Methods," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) hal-03455978, HAL.
- Denis Fougère & Nicolas Jacquemet, 2021. "Policy Evaluation Using Causal Inference Methods," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) hal-03098058, HAL.
- Denis Fougère & Nicolas Jacquemet, 2021. "Policy Evaluation Using Causal Inference Methods," PSE-Ecole d'économie de Paris (Postprint) hal-03098058, HAL.
- Denis Fougère & Nicolas Jacquemet, 2020. "Policy Evaluation Using Causal Inference Methods," Working Papers hal-03455978, HAL.
- Denis Fougère & Nicolas Jacquemet, 2021. "Policy Evaluation Using Causal Inference Methods," Post-Print hal-03098058, HAL.
- Denis Fougère & Nicolas Jacquemet, 2021. "Policy Evaluation Using Causal Inference Methods," SciencePo Working papers Main hal-03098058, HAL.
- Fougère, Denis & Jacquemet, Nicolas, 2020. "Policy Evaluation Using Causal Inference Methods," IZA Discussion Papers 12922, Institute of Labor Economics (IZA).
- Galiani, Sebastian & Quistorff, Brian, 2024.
"Assessing external validity in practice,"
Research in Economics, Elsevier, vol. 78(3).
- Sebastian Galiani & Brian Quistorff, 2022. "Assessing External Validity in Practice," NBER Working Papers 30398, National Bureau of Economic Research, Inc.
- Jörg Peters & Jörg Langbein & Gareth Roberts, 2018.
"Generalization in the Tropics – Development Policy, Randomized Controlled Trials, and External Validity,"
The World Bank Research Observer, World Bank, vol. 33(1), pages 34-64.
- Peters, Jörg & Langbein, Jörg & Roberts, Gareth, 2017. "Generalization in the Tropics: Development policy, randomized controlled trials, and external validity," Ruhr Economic Papers 716, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
- Takuya Ishihara & Toru Kitagawa, 2021. "Evidence Aggregation for Treatment Choice," Papers 2108.06473, arXiv.org, revised Jul 2024.
- Xinkun Nie & Guido Imbens & Stefan Wager, 2021. "Covariate Balancing Sensitivity Analysis for Extrapolating Randomized Trials across Locations," Papers 2112.04723, arXiv.org.
- Stefano DellaVigna & Elizabeth Linos, 2022.
"RCTs to Scale: Comprehensive Evidence From Two Nudge Units,"
Econometrica, Econometric Society, vol. 90(1), pages 81-116, January.
- Stefano DellaVigna & Elizabeth Linos, 2020. "RCTs to Scale: Comprehensive Evidence from Two Nudge Units," NBER Working Papers 27594, National Bureau of Economic Research, Inc.
- Andor, Mark A. & Gerster, Andreas & Peters, Jörg, 2022.
"Information campaigns for residential energy conservation,"
European Economic Review, Elsevier, vol. 144(C).
- Andor, Mark Andreas & Gerster, Andreas & Peters, Jörg, 2020. "Information campaigns for residential energy conservation," Ruhr Economic Papers 871, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
- Esterling, Kevin & Brady, David & Schwitzgebel, Eric, 2021. "The Necessity of Construct and External Validity for Generalized Causal Claims," OSF Preprints 2s8w5, Center for Open Science.
- Rajeev Dehejia & Cristian Pop-Eleches & Cyrus Samii, 2021.
"From Local to Global: External Validity in a Fertility Natural Experiment,"
Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(1), pages 217-243, January.
- Dehejia, Rajeev & Pop-Eleches, Cristian & Samii, Cyrus, 2015. "From Local to Global: External Validity in a Fertility Natural Experiment," IZA Discussion Papers 9300, Institute of Labor Economics (IZA).
- Rajeev Dehejia & Cristian Pop-Eleches & Cyrus Samii, 2015. "From Local to Global: External Validity in a Fertility Natural Experiment," NBER Working Papers 21459, National Bureau of Economic Research, Inc.
- Rajeev Dehejia & Cristian Pop-Eleches & Cyrus Samii, 2019. "From Local to Global: External Validity in a Fertility Natural Experiment," Papers 1906.08096, arXiv.org.
- Rajeev H. Dehejia & Cristian Pop-Eleches & Cyrus Samii, 2015. "From Local to Global: External Validity in a Fertility Natural Experiment," CESifo Working Paper Series 5493, CESifo.
- Paul Hunermund & Elias Bareinboim, 2019. "Causal Inference and Data Fusion in Econometrics," Papers 1912.09104, arXiv.org, revised Mar 2023.
- Masselus, Lise & Petrik, Christina & Ankel-Peters, Jörg, 2024. "Lost in the Design Space? Construct Validity in the Microfinance Literature," OSF Preprints nwp8k_v1, Center for Open Science.
- Peters, Jörg & Langbein, Jörg & Roberts, Gareth, 2016.
"Policy evaluation, randomized controlled trials, and external validity—A systematic review,"
Economics Letters, Elsevier, vol. 147(C), pages 51-54.
- Peters, Jörg & Langbein, Jörg & Roberts, Gareth, 2015. "Policy evaluation, randomized controlled trials, and external validity: A systematic review," Ruhr Economic Papers 589, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
- Denis Fougère & Nicolas Jacquemet, 2019.
"Causal Inference and Impact Evaluation,"
Economie et Statistique / Economics and Statistics, Institut National de la Statistique et des Etudes Economiques (INSEE), issue 510-511-5, pages 181-200.
- Denis Fougère & Nicolas Jacquemet, 2019. "Causal Inference and Impact Evaluation," SciencePo Working papers Main hal-02866828, HAL.
- Denis Fougère & Nicolas Jacquemet, 2019. "Causal Inference and Impact Evaluation," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) hal-02866828, HAL.
- Denis Fougère & Nicolas Jacquemet, 2019. "Causal Inference and Impact Evaluation," Post-Print hal-02866828, HAL.
- Denis Fougère & Nicolas Jacquemet, 2019. "Causal Inference and Impact Evaluation," PSE-Ecole d'économie de Paris (Postprint) hal-02866828, HAL.
- Michael Gechter & Keisuke Hirano & Jean Lee & Mahreen Mahmud & Orville Mondal & Jonathan Morduch & Saravana Ravindran & Abu S. Shonchoy, 2024. "Selecting Experimental Sites for External Validity," Papers 2405.13241, arXiv.org.
- Ashley L. Buchanan & Michael G. Hudgens & Stephen R. Cole & Katie R. Mollan & Paul E. Sax & Eric S. Daar & Adaora A. Adimora & Joseph J. Eron & Michael J. Mugavero, 2018. "Generalizing evidence from randomized trials using inverse probability of sampling weights," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 181(4), pages 1193-1209, October.
- Bo, Hao & Galiani, Sebastian, 2021.
"Assessing external validity,"
Research in Economics, Elsevier, vol. 75(3), pages 274-285.
- Hao Bo & Sebastian Galiani, 2019. "Assessing External Validity," NBER Working Papers 26422, National Bureau of Economic Research, Inc.
- Frederico Finan & Demian Pouzo, 2021. "Reinforcing RCTs with Multiple Priors while Learning about External Validity," Papers 2112.09170, arXiv.org, revised Sep 2024.
- Ashis Das & Jed Friedman & Eeshani Kandpal, 2018. "Does involvement of local NGOs enhance public service delivery? Cautionary evidence from a malaria‐prevention program in India," Health Economics, John Wiley & Sons, Ltd., vol. 27(1), pages 172-188, January.
- Meager, Rachael, 2022. "Aggregating distributional treatment effects: a Bayesian hierarchical analysis of the microcredit literature," LSE Research Online Documents on Economics 115559, London School of Economics and Political Science, LSE Library.
More about this item
Keywords
External validity; Randomized trials;JEL classification:
- C1 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General
Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecolet:v:178:y:2019:i:c:p:58-62. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ecolet .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.