Asymptotic Theory for IV-Based Reinforcement Learning with Potential Endogeneity
Author
Abstract
Suggested Citation
Download full text from publisher
References listed on IDEAS
- Alchian, Armen A & Demsetz, Harold, 1972.
"Production , Information Costs, and Economic Organization,"
American Economic Review, American Economic Association, vol. 62(5), pages 777-795, December.
- Armen A. Alchian & Harold Demsetz, 1971. "Production, Information Costs and Economic Organizations," UCLA Economics Working Papers 10A, UCLA Department of Economics.
- Guido W. Imbens, 2020.
"Potential Outcome and Directed Acyclic Graph Approaches to Causality: Relevance for Empirical Practice in Economics,"
Journal of Economic Literature, American Economic Association, vol. 58(4), pages 1129-1179, December.
- Guido Imbens, 2019. "Potential Outcome and Directed Acyclic Graph Approaches to Causality: Relevance for Empirical Practice in Economics," NBER Working Papers 26104, National Bureau of Economic Research, Inc.
- Hansen, Lars Peter, 1982. "Large Sample Properties of Generalized Method of Moments Estimators," Econometrica, Econometric Society, vol. 50(4), pages 1029-1054, July.
- Angrist, Joshua D. & Krueger, Alan B., 1999.
"Empirical strategies in labor economics,"
Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 23, pages 1277-1366,
Elsevier.
- Alan B. Krueger & Joshua D. Angrist, 1998. "Empirical Strategies in Labor Economics," Working Papers 780, Princeton University, Department of Economics, Industrial Relations Section..
- Joshua Angrist & Alan Krueger, 1998. "Empirical Strategies in Labor Economics," Working papers 98-7, Massachusetts Institute of Technology (MIT), Department of Economics.
- Angrist, Joshua D, 1990. "Lifetime Earnings and the Vietnam Era Draft Lottery: Evidence from Social Security Administrative Records: Errata," American Economic Review, American Economic Association, vol. 80(5), pages 1284-1286, December.
- Stephen Morris, 2001.
"Political Correctness,"
Journal of Political Economy, University of Chicago Press, vol. 109(2), pages 231-265, April.
- Stephen Morris, 1999. "Political Correctness," Cowles Foundation Discussion Papers 1242, Cowles Foundation for Research in Economics, Yale University.
- Heckman, James, 2013.
"Sample selection bias as a specification error,"
Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 31(3), pages 129-137.
- Heckman, James J, 1979. "Sample Selection Bias as a Specification Error," Econometrica, Econometric Society, vol. 47(1), pages 153-161, January.
- Angrist, Joshua D, 1990.
"Lifetime Earnings and the Vietnam Era Draft Lottery: Evidence from Social Security Administrative Records,"
American Economic Review, American Economic Association, vol. 80(3), pages 313-336, June.
- Joshua D. Angrist, 1989. "Lifetime Earnings and the Vietnam Era Draft Lottery: Evidence from Social Security Administrative Records," Working Papers 631, Princeton University, Department of Economics, Industrial Relations Section..
- Levitt, Steven D, 1997.
"Using Electoral Cycles in Police Hiring to Estimate the Effect of Police on Crime,"
American Economic Review, American Economic Association, vol. 87(3), pages 270-290, June.
- Steven D. Levitt, 1995. "Using Electoral Cycles in Police Hiring to Estimate the Effect of Policeon Crime," NBER Working Papers 4991, National Bureau of Economic Research, Inc.
- Victor Chernozhukov & Christian Hansen, 2005. "An IV Model of Quantile Treatment Effects," Econometrica, Econometric Society, vol. 73(1), pages 245-261, January.
- Newey, Whitney & West, Kenneth, 2014.
"A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix,"
Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
- Newey, Whitney K & West, Kenneth D, 1987. "A Simple, Positive Semi-definite, Heteroskedasticity and Autocorrelation Consistent Covariance Matrix," Econometrica, Econometric Society, vol. 55(3), pages 703-708, May.
- Whitney K. Newey & Kenneth D. West, 1986. "A Simple, Positive Semi-Definite, Heteroskedasticity and AutocorrelationConsistent Covariance Matrix," NBER Technical Working Papers 0055, National Bureau of Economic Research, Inc.
- Holmstrom, Bengt & Milgrom, Paul, 1991. "Multitask Principal-Agent Analyses: Incentive Contracts, Asset Ownership, and Job Design," The Journal of Law, Economics, and Organization, Oxford University Press, vol. 7(0), pages 24-52, Special I.
- Joshua D. Angrist & Alan B. Keueger, 1991.
"Does Compulsory School Attendance Affect Schooling and Earnings?,"
The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 106(4), pages 979-1014.
- Joshua D. Angrist & Alan B. Krueger, 1990. "Does Compulsory School Attendance Affect Schooling and Earnings?," Working Papers 653, Princeton University, Department of Economics, Industrial Relations Section..
- Joshua D. Angrist & Alan B. Krueger, 1990. "Does Compulsory School Attendance Affect Schooling and Earnings?," NBER Working Papers 3572, National Bureau of Economic Research, Inc.
- Thomas Blake & Chris Nosko & Steven Tadelis, 2015.
"Consumer Heterogeneity and Paid Search Effectiveness: A Large‐Scale Field Experiment,"
Econometrica, Econometric Society, vol. 83, pages 155-174, January.
- Tom Blake & Chris Nosko & Steven Tadelis, 2014. "Consumer Heterogeneity and Paid Search Effectiveness: A Large Scale Field Experiment," NBER Working Papers 20171, National Bureau of Economic Research, Inc.
- Hausman, Jerry A., 1983. "Specification and estimation of simultaneous equation models," Handbook of Econometrics, in: Z. Griliches† & M. D. Intriligator (ed.), Handbook of Econometrics, edition 1, volume 1, chapter 7, pages 391-448, Elsevier.
- Justin P. Johnson & Andrew Rhodes & Matthijs Wildenbeest, 2023.
"Platform Design When Sellers Use Pricing Algorithms,"
Econometrica, Econometric Society, vol. 91(5), pages 1841-1879, September.
- Johnson, Justin Pappas & Rhodes, Andrew & Wildenbeest, Matthijs, 2020. "Platform Design when Sellers Use Pricing Algorithms," TSE Working Papers 20-1146, Toulouse School of Economics (TSE).
- Justin Pappas Johnson & Andrew Rhodes & Matthijs Wildenbeest, 2023. "Platform design when sellers use pricing algorithms," Post-Print hal-04226232, HAL.
- Rhodes, Andrew & Johnson, Justin & Wildenbeest, Matthijs, 2020. "Platform Design When Sellers Use Pricing Algorithms," CEPR Discussion Papers 15504, C.E.P.R. Discussion Papers.
- Julian Schrittwieser & Ioannis Antonoglou & Thomas Hubert & Karen Simonyan & Laurent Sifre & Simon Schmitt & Arthur Guez & Edward Lockhart & Demis Hassabis & Thore Graepel & Timothy Lillicrap & David , 2020. "Mastering Atari, Go, chess and shogi by planning with a learned model," Nature, Nature, vol. 588(7839), pages 604-609, December.
- Emilio Calvano & Giacomo Calzolari & Vincenzo Denicolò & Sergio Pastorello, 2020.
"Artificial Intelligence, Algorithmic Pricing, and Collusion,"
American Economic Review, American Economic Association, vol. 110(10), pages 3267-3297, October.
- Calzolari, Giacomo & Calvano, Emilio & Denicolo, Vincenzo & Pastorello, Sergio, 2018. "Artificial intelligence, algorithmic pricing and collusion," CEPR Discussion Papers 13405, C.E.P.R. Discussion Papers.
- A. Belloni & D. Chen & V. Chernozhukov & C. Hansen, 2012.
"Sparse Models and Methods for Optimal Instruments With an Application to Eminent Domain,"
Econometrica, Econometric Society, vol. 80(6), pages 2369-2429, November.
- Alexandre Belloni & D. Chen & Victor Chernozhukov & Christian Hansen, 2010. "Sparse models and methods for optimal instruments with an application to eminent domain," CeMMAP working papers CWP31/10, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
- Alexandre Belloni & Daniel Chen & Victor Chernozhukov & Christian Hansen, 2010. "Sparse Models and Methods for Optimal Instruments with an Application to Eminent Domain," Papers 1010.4345, arXiv.org, revised Apr 2015.
- Imbens, Guido W., 2014.
"Instrumental Variables: An Econometrician's Perspective,"
IZA Discussion Papers
8048, Institute of Labor Economics (IZA).
- Guido Imbens, 2014. "Instrumental Variables: An Econometrician's Perspective," NBER Working Papers 19983, National Bureau of Economic Research, Inc.
- Danielle Li & Lindsey R. Raymond & Peter Bergman, 2020.
"Hiring as Exploration,"
NBER Working Papers
27736, National Bureau of Economic Research, Inc.
- Danielle Li & Lindsey Raymond & Peter Bergman, 2024. "Hiring as Exploration," Papers 2411.03616, arXiv.org.
- Imbens, Guido W & Angrist, Joshua D, 1994.
"Identification and Estimation of Local Average Treatment Effects,"
Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
- Joshua D. Angrist & Guido W. Imbens, 1995. "Identification and Estimation of Local Average Treatment Effects," NBER Technical Working Papers 0118, National Bureau of Economic Research, Inc.
- Griliches, Zvi, 1977. "Estimating the Returns to Schooling: Some Econometric Problems," Econometrica, Econometric Society, vol. 45(1), pages 1-22, January.
- Whitney K. Newey & James L. Powell, 2003. "Instrumental Variable Estimation of Nonparametric Models," Econometrica, Econometric Society, vol. 71(5), pages 1565-1578, September.
- Chunrong Ai & Xiaohong Chen, 2003. "Efficient Estimation of Models with Conditional Moment Restrictions Containing Unknown Functions," Econometrica, Econometric Society, vol. 71(6), pages 1795-1843, November.
- Heckman, James J, 1990. "Varieties of Selection Bias," American Economic Review, American Economic Association, vol. 80(2), pages 313-318, May.
- Chernozhukov, Victor & Imbens, Guido W. & Newey, Whitney K., 2007. "Instrumental variable estimation of nonseparable models," Journal of Econometrics, Elsevier, vol. 139(1), pages 4-14, July.
- Mila Nambiar & David Simchi-Levi & He Wang, 2019. "Dynamic Learning and Pricing with Model Misspecification," Management Science, INFORMS, vol. 65(11), pages 4980-5000, November.
- Prendergast, Canice, 1993. "A Theory of "Yes Men."," American Economic Review, American Economic Association, vol. 83(4), pages 757-770, September.
- Xiaohong Chen & Han Hong & Elie Tamer, 2005. "Measurement Error Models with Auxiliary Data," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 72(2), pages 343-366.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Jingwen Zhang & Yifang Chen & Amandeep Singh, 2022. "Causal Bandits: Online Decision-Making in Endogenous Settings," Papers 2211.08649, arXiv.org, revised Feb 2023.
- Peter Hull & Michal Kolesár & Christopher Walters, 2022.
"Labor by design: contributions of David Card, Joshua Angrist, and Guido Imbens,"
Scandinavian Journal of Economics, Wiley Blackwell, vol. 124(3), pages 603-645, July.
- Peter Hull & Michal Koles'ar & Christopher Walters, 2022. "Labour by Design: Contributions of David Card, Joshua Angrist, and Guido Imbens," Papers 2203.16405, arXiv.org.
- Guido W. Imbens & Jeffrey M. Wooldridge, 2009.
"Recent Developments in the Econometrics of Program Evaluation,"
Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
- Guido M. Imbens & Jeffrey M. Wooldridge, 2008. "Recent Developments in the Econometrics of Program Evaluation," NBER Working Papers 14251, National Bureau of Economic Research, Inc.
- Wooldridge, Jeffrey M. & Imbens, Guido, 2009. "Recent Developments in the Econometrics of Program Evaluation," Scholarly Articles 3043416, Harvard University Department of Economics.
- Guido Imbens & Jeffrey M. Wooldridge, 2008. "Recent developments in the econometrics of program evaluation," CeMMAP working papers CWP24/08, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
- Imbens, Guido W. & Wooldridge, Jeffrey M., 2008. "Recent Developments in the Econometrics of Program Evaluation," IZA Discussion Papers 3640, Institute of Labor Economics (IZA).
- Thomas J. Kane & Cecilia E. Rouse, 1993. "Labor Market Returns to Two- and Four-Year Colleges: Is a Credit a Credit and Do Degrees Matter?," NBER Working Papers 4268, National Bureau of Economic Research, Inc.
- Qin, Duo, 2014. "Resurgence of instrument variable estimation and fallacy of endogeneity," Economics Discussion Papers 2014-42, Kiel Institute for the World Economy (IfW Kiel).
- Guilhem Bascle, 2008. "Controlling for endogeneity with instrumental variables in strategic management research," Post-Print hal-00576795, HAL.
- Halbert White & Karim Chalak, 2013. "Identification and Identification Failure for Treatment Effects Using Structural Systems," Econometric Reviews, Taylor & Francis Journals, vol. 32(3), pages 273-317, November.
- Guido W. Imbens, 2022. "Causality in Econometrics: Choice vs Chance," Econometrica, Econometric Society, vol. 90(6), pages 2541-2566, November.
- Heckman, James J. & Lochner, Lance J. & Todd, Petra E., 2006.
"Earnings Functions, Rates of Return and Treatment Effects: The Mincer Equation and Beyond,"
Handbook of the Economics of Education, in: Erik Hanushek & F. Welch (ed.), Handbook of the Economics of Education, edition 1, volume 1, chapter 7, pages 307-458,
Elsevier.
- James J. Heckman & Lance J. Lochner & Petra E. Todd, 2005. "Earnings Functions, Rates of Return and Treatment Effects: The Mincer Equation and Beyond," NBER Working Papers 11544, National Bureau of Economic Research, Inc.
- Heckman, James J. & Lochner, Lance John & Todd, Petra E., 2005. "Earnings Functions, Rates of Return and Treatment Effects: The Mincer Equation and Beyond," IZA Discussion Papers 1700, Institute of Labor Economics (IZA).
- Joshua D. Angrist & Alan B. Krueger, 2001.
"Instrumental Variables and the Search for Identification: From Supply and Demand to Natural Experiments,"
Journal of Economic Perspectives, American Economic Association, vol. 15(4), pages 69-85, Fall.
- Joshua Angrist & Alan B. Krueger, 2001. "Instrumental Variables and the Search for Identification: From Supply and Demand to Natural Experiments," NBER Working Papers 8456, National Bureau of Economic Research, Inc.
- Joshua D. Angrist & Alan B. Krueger, 2001. "Instrumental Variables and the Search for Identification: From Supply and Demand to Natural Experiments," Working Papers 834, Princeton University, Department of Economics, Industrial Relations Section..
- Frolich, Markus, 2007.
"Nonparametric IV estimation of local average treatment effects with covariates,"
Journal of Econometrics, Elsevier, vol. 139(1), pages 35-75, July.
- Frölich, Markus, 2002. "Nonparametric IV Estimation of Local Average Treatment Effects with Covariates," IZA Discussion Papers 588, Institute of Labor Economics (IZA).
- Markus Froelich, 2002. "Nonparametric IV estimation of local average treatment effects with covariates," University of St. Gallen Department of Economics working paper series 2002 2002-19, Department of Economics, University of St. Gallen.
- van der Klaauw, Bas, 2014.
"From micro data to causality: Forty years of empirical labor economics,"
Labour Economics, Elsevier, vol. 30(C), pages 88-97.
- van der Klaauw, Bas, 2014. "From Micro Data to Causality: Forty Years of Empirical Labor Economics," IZA Discussion Papers 8047, Institute of Labor Economics (IZA).
- Chen, Xiaohong, 2007. "Large Sample Sieve Estimation of Semi-Nonparametric Models," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 76, Elsevier.
- Committee, Nobel Prize, 2021. "Answering causal questions using observational data," Nobel Prize in Economics documents 2021-2, Nobel Prize Committee.
- Halbert White & Karim Chalak, 2008. "Identifying Structural Effects in Nonseparable Systems Using Covariates," Boston College Working Papers in Economics 734, Boston College Department of Economics.
- Xiaohong Chen & Andres Santos, 2018.
"Overidentification in Regular Models,"
Econometrica, Econometric Society, vol. 86(5), pages 1771-1817, September.
- Xiaohong Chen & Andres Santos, 2015. "Overidentification in Regular Models," Cowles Foundation Discussion Papers 1999, Cowles Foundation for Research in Economics, Yale University.
- Xiaohong Chen & Andres Santos, 2015. "Overidentification in Regular Models," Cowles Foundation Discussion Papers 1999R, Cowles Foundation for Research in Economics, Yale University, revised Jun 2018.
- Arthur Lewbel, 2012.
"Using Heteroscedasticity to Identify and Estimate Mismeasured and Endogenous Regressor Models,"
Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(1), pages 67-80.
- Arthur Lewbel, 2010. "Using Heteroscedasticity to Identify and Estimate Mismeasured and Endogenous Regressor Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(1), pages 67-80, December.
- Arthur Lewbel, 2003. "Using Heteroskedasticity to Identify and Estimate Mismeasured and Endogenous Regressor Models," Boston College Working Papers in Economics 587, Boston College Department of Economics, revised 15 Dec 2010.
- Xiaohong Chen & Victor Chernozhukov & Sokbae Lee & Whitney K. Newey, 2014.
"Local Identification of Nonparametric and Semiparametric Models,"
Econometrica, Econometric Society, vol. 82(2), pages 785-809, March.
- Xiaohong Chen & Victor Chernozhukov & Sokbae Lee & Whitney Newey, 2011. "Local Identification of Nonparametric and Semiparametric Models," Cowles Foundation Discussion Papers 1795, Cowles Foundation for Research in Economics, Yale University.
- Xiaohong Chen & Victor Chernozhukov & Sokbae (Simon) Lee & Whitney K. Newey, 2012. "Local identification of nonparametric and semiparametric models," CeMMAP working papers 37/12, Institute for Fiscal Studies.
- Xiaohong Chen & Victor Chernozhukov & Sokbae (Simon) Lee & Whitney K. Newey, 2011. "Local identification of nonparametric and semiparametric models," CeMMAP working papers 17/11, Institute for Fiscal Studies.
- Xiaohong Chen & Victor Chernozhukov & Sokbae Lee & Whitney Newey, 2011. "Local Identification of Nonparametric and Semiparametric Models," Cowles Foundation Discussion Papers 1795R, Cowles Foundation for Research in Economics, Yale University, revised Nov 2012.
- Xiaohong Chen & Victor Chernozhukov & Sokbae (Simon) Lee & Whitney K. Newey, 2011. "Local identification of nonparametric and semiparametric models," CeMMAP working papers CWP17/11, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
- Xiaohong Chen & Victor Chernozhukov & Sokbae (Simon) Lee & Whitney K. Newey, 2012. "Local identification of nonparametric and semiparametric models," CeMMAP working papers CWP37/12, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
- Markus Frölich, 2004.
"Programme Evaluation with Multiple Treatments,"
Journal of Economic Surveys, Wiley Blackwell, vol. 18(2), pages 181-224, April.
- Frölich, Markus, 2002. "Programme Evaluation with Multiple Treatments," IZA Discussion Papers 542, Institute of Labor Economics (IZA).
- Markus Froelich, 2002. "Programme Evaluation with Multiple Treatments," University of St. Gallen Department of Economics working paper series 2002 2002-17, Department of Economics, University of St. Gallen.
- Hall, George & Rust, John, 2021. "Estimation of endogenously sampled time series: The case of commodity price speculation in the steel market," Journal of Econometrics, Elsevier, vol. 222(1), pages 219-243.
More about this item
NEP fields
This paper has been announced in the following NEP Reports:- NEP-BIG-2021-03-22 (Big Data)
- NEP-ECM-2021-03-22 (Econometrics)
- NEP-ORE-2021-03-22 (Operations Research)
Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2103.04021. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.