Efficient Counterfactual Learning from Bandit Feedback
Author
Abstract
Suggested Citation
Download full text from publisher
References listed on IDEAS
- Daniel Ackerberg & Xiaohong Chen & Jinyong Hahn & Zhipeng Liao, 2014.
"Asymptotic Efficiency of Semiparametric Two-step GMM,"
The Review of Economic Studies, Review of Economic Studies Ltd, vol. 81(3), pages 919-943.
- Xiaohong Chen & Jinyong Hahn, 2012. "Asymptotic efficiency of semiparametric two-step GMM," CeMMAP working papers CWP31/12, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
- Daniel Ackerberg & Xiaohong Chen & Jinyong Hahn, 2014. "Asymptotic efficiency of semiparametric two-step GMM," CeMMAP working papers 28/14, Institute for Fiscal Studies.
- Xiaohong Chen & Jinyong Hahn & Zhipeng Liao, 2012. "Asymptotic Efficiency of Semiparametric Two-step GMM," Cowles Foundation Discussion Papers 1880, Cowles Foundation for Research in Economics, Yale University.
- Daniel Ackerberg & Xiaohong Chen & Jinyong Hahn, 2014. "Asymptotic efficiency of semiparametric two-step GMM," CeMMAP working papers CWP28/14, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
- Xiaohong Chen & Jinyong Hahn, 2012. "Asymptotic efficiency of semiparametric two-step GMM," CeMMAP working papers 31/12, Institute for Fiscal Studies.
- Stefan Wager & Susan Athey, 2018.
"Estimation and Inference of Heterogeneous Treatment Effects using Random Forests,"
Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(523), pages 1228-1242, July.
- Wager, Stefan & Athey, Susan, 2017. "Estimation and Inference of Heterogeneous Treatment Effects Using Random Forests," Research Papers 3576, Stanford University, Graduate School of Business.
- Cattaneo, Matias D., 2010. "Efficient semiparametric estimation of multi-valued treatment effects under ignorability," Journal of Econometrics, Elsevier, vol. 155(2), pages 138-154, April.
- Newey, Whitney K, 1994.
"The Asymptotic Variance of Semiparametric Estimators,"
Econometrica, Econometric Society, vol. 62(6), pages 1349-1382, November.
- Newey, W.K., 1989. "The Asymptotic Variance Of Semiparametric Estimotors," Papers 346, Princeton, Department of Economics - Econometric Research Program.
- Newey, W.K., 1991. "The Asymptotic Variance of Semiparametric Estimators," Working papers 583, Massachusetts Institute of Technology (MIT), Department of Economics.
- Chen, Xiaohong, 2007. "Large Sample Sieve Estimation of Semi-Nonparametric Models," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 76, Elsevier.
- Keisuke Hirano & Guido W. Imbens & Geert Ridder, 2003.
"Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score,"
Econometrica, Econometric Society, vol. 71(4), pages 1161-1189, July.
- Keisuke Hirano & Guido W. Imbens & Geert Ridder, 2000. "Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score," NBER Technical Working Papers 0251, National Bureau of Economic Research, Inc.
- Guido Imbens, 2000. "Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score," Econometric Society World Congress 2000 Contributed Papers 1166, Econometric Society.
- Xinkun Nie & Stefan Wager, 2017. "Quasi-Oracle Estimation of Heterogeneous Treatment Effects," Papers 1712.04912, arXiv.org, revised Aug 2020.
- Newey, Whitney K, 1990. "Semiparametric Efficiency Bounds," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 5(2), pages 99-135, April-Jun.
- Jinyong Hahn, 1998. "On the Role of the Propensity Score in Efficient Semiparametric Estimation of Average Treatment Effects," Econometrica, Econometric Society, vol. 66(2), pages 315-332, March.
- Matias D. Cattaneo, 2010. "multi-valued treatment effects," The New Palgrave Dictionary of Economics,, Palgrave Macmillan.
- Newey, Whitney K., 1997. "Convergence rates and asymptotic normality for series estimators," Journal of Econometrics, Elsevier, vol. 79(1), pages 147-168, July.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
Cited by:
- NARITA Yusuke & YATA Kohei, 2021.
"Algorithm is Experiment: Machine Learning, Market Design, and Policy Eligibility Rules,"
Discussion papers
21057, Research Institute of Economy, Trade and Industry (RIETI).
- Yusuke Narita & Kohei Yata, 2021. "Algorithm is Experiment: Machine Learning, Market Design, and Policy Eligibility Rules," Cowles Foundation Discussion Papers 2283, Cowles Foundation for Research in Economics, Yale University.
- Yusuke Narita & Kohei Yata, 2021. "Algorithm is Experiment: Machine Learning, Market Design, and Policy Eligibility Rules," Working Papers 2021-022, Human Capital and Economic Opportunity Working Group.
- Yusuke Narita & Kohei Yata, 2021. "Algorithm as Experiment: Machine Learning, Market Design, and Policy Eligibility Rules," Papers 2104.12909, arXiv.org, revised Dec 2023.
- Masahiro Kato & Shota Yasui & Kenichiro McAlinn, 2020. "The Adaptive Doubly Robust Estimator for Policy Evaluation in Adaptive Experiments and a Paradox Concerning Logging Policy," Papers 2010.03792, arXiv.org, revised Jun 2021.
- Masahiro Kato & Masatoshi Uehara & Shota Yasui, 2020. "Off-Policy Evaluation and Learning for External Validity under a Covariate Shift," Papers 2002.11642, arXiv.org, revised Oct 2020.
- Masahiro Kato, 2020. "Confidence Interval for Off-Policy Evaluation from Dependent Samples via Bandit Algorithm: Approach from Standardized Martingales," Papers 2006.06982, arXiv.org.
- Patrick Kline & Christopher Walters, 2019.
"Audits as Evidence: Experiments, Ensembles, and Enforcement,"
Papers
1907.06622, arXiv.org, revised Jul 2019.
- Kline, Patrick & Walters, Christopher, 2019. "Audits as Evidence: Experiments, Ensembles, and Enforcement," Institute for Research on Labor and Employment, Working Paper Series qt3z72m9kn, Institute of Industrial Relations, UC Berkeley.
- Masahiro Kato & Yusuke Kaneko, 2020. "Off-Policy Evaluation of Bandit Algorithm from Dependent Samples under Batch Update Policy," Papers 2010.13554, arXiv.org.
- Masahiro Kato, 2021. "Adaptive Doubly Robust Estimator from Non-stationary Logging Policy under a Convergence of Average Probability," Papers 2102.08975, arXiv.org, revised Mar 2021.
- Narita, Yusuke & Yata, Kohei, 2022. "Algorithm is Experiment: Machine Learning, Market Design, and Policy Eligibility Rules," CEI Working Paper Series 2021-05, Center for Economic Institutions, Institute of Economic Research, Hitotsubashi University.
- Narita, Yusuke & Yata, Kohei, 2022. "Algorithm is Experiment: Machine Learning, Market Design, and Policy Eligibility Rules," Discussion Paper Series 730, Institute of Economic Research, Hitotsubashi University.
- Yusuke Narita & Shota Yasui & Kohei Yata, 2020. "Debiased Off-Policy Evaluation for Recommendation Systems," Papers 2002.08536, arXiv.org, revised Aug 2021.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Zhaonan Qu & Ruoxuan Xiong & Jizhou Liu & Guido Imbens, 2021. "Semiparametric Estimation of Treatment Effects in Observational Studies with Heterogeneous Partial Interference," Papers 2107.12420, arXiv.org, revised Jun 2024.
- Chunrong Ai & Oliver Linton & Kaiji Motegi & Zheng Zhang, 2021.
"A unified framework for efficient estimation of general treatment models,"
Quantitative Economics, Econometric Society, vol. 12(3), pages 779-816, July.
- Chunrong Ai & Oliver Linton & Kaiji Motegi & Zheng Zhang, 2018. "A Unified Framework for Efficient Estimation of General Treatment Models," Papers 1808.04936, arXiv.org, revised Aug 2018.
- Chunrong Ai & Oliver Linton & Kaiji Motegi & Zheng Zhang, 2019. "A Unified Framework for Efficient Estimation of General Treatment Models," CeMMAP working papers CWP64/19, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
- Ai, C. & Linton, O. & Motegi, K. & Zhang, Z., 2019. "A Unified Framework for Efficient Estimation of General Treatment Models," Cambridge Working Papers in Economics 1934, Faculty of Economics, University of Cambridge.
- Firpo, Sergio Pinheiro & Pinto, Rafael de Carvalho Cayres, 2012. "Combining Strategies for the Estimation of Treatment Effects," Brazilian Review of Econometrics, Sociedade Brasileira de Econometria - SBE, vol. 32(1), March.
- Ganesh Karapakula, 2023. "Stable Probability Weighting: Large-Sample and Finite-Sample Estimation and Inference Methods for Heterogeneous Causal Effects of Multivalued Treatments Under Limited Overlap," Papers 2301.05703, arXiv.org, revised Jan 2023.
- Su, Liangjun & Ura, Takuya & Zhang, Yichong, 2019.
"Non-separable models with high-dimensional data,"
Journal of Econometrics, Elsevier, vol. 212(2), pages 646-677.
- Su, Liangjun & Ura, Takuya & Zhang, Yichong, 2017. "Non-separable Models with High-dimensional Data," Economics and Statistics Working Papers 15-2017, Singapore Management University, School of Economics.
- Wei Huang & Oliver Linton & Zheng Zhang, 2022.
"A Unified Framework for Specification Tests of Continuous Treatment Effect Models,"
Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 40(4), pages 1817-1830, October.
- Wei Huang & Oliver Linton & Zheng Zhang, 2021. "A Unified Framework for Specification Tests of Continuous Treatment Effect Models," Papers 2102.08063, arXiv.org, revised Sep 2021.
- Huang, W. & Linton, O. & Zhang, Z., 2021. "A Unified Framework for Specification Tests of Continuous Treatment Effect Models," Cambridge Working Papers in Economics 2113, Faculty of Economics, University of Cambridge.
- Difang Huang & Jiti Gao & Tatsushi Oka, 2022.
"Semiparametric Single-Index Estimation for Average Treatment Effects,"
Papers
2206.08503, arXiv.org, revised Jan 2025.
- Difang Huang & Jiti Gao & Tatsushi Oka, 2022. "Semiparametric Single-Index Estimation for Average Treatment Effects," Monash Econometrics and Business Statistics Working Papers 10/22, Monash University, Department of Econometrics and Business Statistics.
- Ai, Chunrong & Linton, Oliver & Zhang, Zheng, 2022. "Estimation and inference for the counterfactual distribution and quantile functions in continuous treatment models," Journal of Econometrics, Elsevier, vol. 228(1), pages 39-61.
- Farrell, Max H., 2015.
"Robust inference on average treatment effects with possibly more covariates than observations,"
Journal of Econometrics, Elsevier, vol. 189(1), pages 1-23.
- Max H. Farrell, 2013. "Robust Inference on Average Treatment Effects with Possibly More Covariates than Observations," Papers 1309.4686, arXiv.org, revised Feb 2018.
- Cattaneo, Matias D., 2010. "Efficient semiparametric estimation of multi-valued treatment effects under ignorability," Journal of Econometrics, Elsevier, vol. 155(2), pages 138-154, April.
- Victor Chernozhukov & Juan Carlos Escanciano & Hidehiko Ichimura & Whitney K. Newey & James M. Robins, 2022.
"Locally Robust Semiparametric Estimation,"
Econometrica, Econometric Society, vol. 90(4), pages 1501-1535, July.
- Victor Chernozhukov & Juan Carlos Escanciano & Hidehiko Ichimura & Whitney K. Newey, 2016. "Locally robust semiparametric estimation," CeMMAP working papers CWP31/16, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
- Victor Chernozhukov & Juan Carlos Escanciano & Hidehiko Ichimura & Whitney K. Newey & James M. Robins, 2016. "Locally Robust Semiparametric Estimation," Papers 1608.00033, arXiv.org, revised Aug 2020.
- Victor Chernozhukov & Juan Carlos Escanciano & Hidehiko Ichimura & Whitney K. Newey & James M. Robins, 2018. "Locally robust semiparametric estimation," CeMMAP working papers CWP30/18, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
- Victor Chernozhukov & Juan Carlos Escanciano & Hidehiko Ichimura & Whitney K. Newey, 2016. "Locally robust semiparametric estimation," CeMMAP working papers 31/16, Institute for Fiscal Studies.
- Rothe, Christoph, 2016. "The Value of Knowing the Propensity Score for Estimating Average Treatment Effects," IZA Discussion Papers 9989, Institute of Labor Economics (IZA).
- Haitian Xie, 2020. "Efficient and Robust Estimation of the Generalized LATE Model," Papers 2001.06746, arXiv.org, revised Feb 2022.
- Sant’Anna, Pedro H.C. & Zhao, Jun, 2020.
"Doubly robust difference-in-differences estimators,"
Journal of Econometrics, Elsevier, vol. 219(1), pages 101-122.
- Pedro H. C. Sant'Anna & Jun B. Zhao, 2018. "Doubly Robust Difference-in-Differences Estimators," Papers 1812.01723, arXiv.org, revised May 2020.
- Michael C. Knaus, 2021.
"A double machine learning approach to estimate the effects of musical practice on student’s skills,"
Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 184(1), pages 282-300, January.
- Knaus, Michael C., 2018. "A Double Machine Learning Approach to Estimate the Effects of Musical Practice on Student's Skills," IZA Discussion Papers 11547, Institute of Labor Economics (IZA).
- Michael C. Knaus, 2018. "A Double Machine Learning Approach to Estimate the Effects of Musical Practice on Student's Skills," Papers 1805.10300, arXiv.org, revised Jan 2019.
- Alexandre Belloni & Victor Chernozhukov & Ivan Fernandez-Val & Christian Hansen, 2013.
"Program evaluation with high-dimensional data,"
CeMMAP working papers
CWP77/13, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
- Alexandre Belloni & Victor Chernozhukov & Ivan Fernandez-Val & Christian Hansen, 2015. "Program evaluation with high-dimensional data," CeMMAP working papers 55/15, Institute for Fiscal Studies.
- Alexandre Belloni & Victor Chernozhukov & Ivan Fernandez-Val & Christian Hansen, 2014. "Program evaluation with high-dimensional data," CeMMAP working papers CWP33/14, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
- Victor Chernozhukov & Ivan Fernandez-Val & Christian Hansen, 2013. "Program evaluation with high-dimensional data," CeMMAP working papers 57/13, Institute for Fiscal Studies.
- Alexandre Belloni & Victor Chernozhukov & Ivan Fernandez-Val & Christian Hansen, 2015. "Program evaluation with high-dimensional data," CeMMAP working papers CWP55/15, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
- Alexandre Belloni & Victor Chernozhukov & Ivan Fernandez-Val & Christian Hansen, 2014. "Program evaluation with high-dimensional data," CeMMAP working papers 33/14, Institute for Fiscal Studies.
- Alexandre Belloni & Victor Chernozhukov & Ivan Fernandez-Val & Christian Hansen, 2013. "Program evaluation with high-dimensional data," CeMMAP working papers 77/13, Institute for Fiscal Studies.
- Victor Chernozhukov & Ivan Fernandez-Val & Christian Hansen, 2013. "Program evaluation with high-dimensional data," CeMMAP working papers CWP57/13, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
- Hidehiko Ichimura & Whitney K. Newey, 2022.
"The influence function of semiparametric estimators,"
Quantitative Economics, Econometric Society, vol. 13(1), pages 29-61, January.
- Hidehiko Ichimura & Whitney K. Newey, 2015. "The influence function of semiparametric estimators," CeMMAP working papers 44/15, Institute for Fiscal Studies.
- Hidehiko Ichimura & Whitney K. Newey, 2015. "The influence function of semiparametric estimators," CeMMAP working papers CWP44/15, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
- Hidehiko Ichimura & Whitney K. Newey, 2017. "The influence function of semiparametric estimators," CeMMAP working papers CWP06/17, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
- Hidehiko Ichimura & Whitney K. Newey, 2015. "The Influence Function of Semiparametric Estimators," CIRJE F-Series CIRJE-F-985, CIRJE, Faculty of Economics, University of Tokyo.
- Hidehiko Ichimura & Whitney K. Newey, 2017. "The influence function of semiparametric estimators," CeMMAP working papers 06/17, Institute for Fiscal Studies.
- Graham, Bryan S. & Pinto, Cristine Campos de Xavier, 2022.
"Semiparametrically efficient estimation of the average linear regression function,"
Journal of Econometrics, Elsevier, vol. 226(1), pages 115-138.
- Bryan S. Graham & Cristine Campos de Xavier Pinto, 2018. "Semiparametrically Efficient Estimation of the Average Linear Regression Function," NBER Working Papers 25234, National Bureau of Economic Research, Inc.
- Bryan S. Graham & Cristine Campos de Xavier Pinto, 2018. "Semiparametrically efficient estimation of the average linear regression function," CeMMAP working papers CWP62/18, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
- Bryan S. Graham & Cristine Campos de Xavier Pinto, 2018. "Semiparametrically efficient estimation of the average linear regression function," Papers 1810.12511, arXiv.org.
- Rahul Singh & Liyuan Xu & Arthur Gretton, 2020. "Kernel Methods for Causal Functions: Dose, Heterogeneous, and Incremental Response Curves," Papers 2010.04855, arXiv.org, revised Oct 2022.
- Cui, Li-E & Zhao, Puying & Tang, Niansheng, 2022. "Generalized empirical likelihood for nonsmooth estimating equations with missing data," Journal of Multivariate Analysis, Elsevier, vol. 190(C).
More about this item
Keywords
Machine Learning; Artificial Intelligence; Bandit Algorithm; Counterfactual Prediction; Propensity Score; Semiparametric Efficiency Bound; Advertisement Design;All these keywords.
NEP fields
This paper has been announced in the following NEP Reports:- NEP-BIG-2018-12-24 (Big Data)
- NEP-CMP-2018-12-24 (Computational Economics)
Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cwl:cwldpp:2155. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Brittany Ladd (email available below). General contact details of provider: https://edirc.repec.org/data/cowleus.html .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.