IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2110.06763.html
   My bibliography  Save this paper

Efficient Estimation in NPIV Models: A Comparison of Various Neural Networks-Based Estimators

Author

Listed:
  • Jiafeng Chen
  • Xiaohong Chen
  • Elie Tamer

Abstract

Artificial Neural Networks (ANNs) can be viewed as nonlinear sieves that can approximate complex functions of high dimensional variables more effectively than linear sieves. We investigate the performance of various ANNs in nonparametric instrumental variables (NPIV) models of moderately high dimensional covariates that are relevant to empirical economics. We present two efficient procedures for estimation and inference on a weighted average derivative (WAD): an orthogonalized plug-in with optimally-weighted sieve minimum distance (OP-OSMD) procedure and a sieve efficient score (ES) procedure. Both estimators for WAD use ANN sieves to approximate the unknown NPIV function and are root-n asymptotically normal and first-order equivalent. We provide a detailed practitioner's recipe for implementing both efficient procedures. We compare their finite-sample performances in various simulation designs that involve smooth NPIV function of up to 13 continuous covariates, different nonlinearities and covariate correlations. Some Monte Carlo findings include: 1) tuning and optimization are more delicate in ANN estimation; 2) given proper tuning, both ANN estimators with various architectures can perform well; 3) easier to tune ANN OP-OSMD estimators than ANN ES estimators; 4) stable inferences are more difficult to achieve with ANN (than spline) estimators; 5) there are gaps between current implementations and approximation theories. Finally, we apply ANN NPIV to estimate average partial derivatives in two empirical demand examples with multivariate covariates.

Suggested Citation

  • Jiafeng Chen & Xiaohong Chen & Elie Tamer, 2021. "Efficient Estimation in NPIV Models: A Comparison of Various Neural Networks-Based Estimators," Papers 2110.06763, arXiv.org, revised Oct 2022.
  • Handle: RePEc:arx:papers:2110.06763
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2110.06763
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Chen, Xiaohong & Pouzo, Demian & Powell, James L., 2019. "Penalized sieve GEL for weighted average derivatives of nonparametric quantile IV regressions," Journal of Econometrics, Elsevier, vol. 213(1), pages 30-53.
    2. Xiaohong Chen & Demian Pouzo, 2015. "Sieve Wald and QLR Inferences on Semi/Nonparametric Conditional Moment Models," Econometrica, Econometric Society, vol. 83(3), pages 1013-1079, May.
    3. Steven Berry & Philip Haile, 2016. "Identification in Differentiated Products Markets," Annual Review of Economics, Annual Reviews, vol. 8(1), pages 27-52, October.
    4. Victor Chernozhukov & Denis Chetverikov & Mert Demirer & Esther Duflo & Christian Hansen & Whitney Newey & James Robins, 2018. "Double/debiased machine learning for treatment and structural parameters," Econometrics Journal, Royal Economic Society, vol. 21(1), pages 1-68, February.
    5. Severini, Thomas A. & Tripathi, Gautam, 2013. "Semiparametric Efficiency Bounds for Microeconometric Models: A Survey," Foundations and Trends(R) in Econometrics, now publishers, vol. 6(3-4), pages 163-397, December.
    6. Richard Blundell & Joel Horowitz & Matthias Parey, 2017. "Nonparametric Estimation of a Nonseparable Demand Function under the Slutsky Inequality Restriction," The Review of Economics and Statistics, MIT Press, vol. 99(2), pages 291-304, May.
    7. Xiaohong Chen & Timothy M. Christensen, 2018. "Optimal sup‐norm rates and uniform inference on nonlinear functionals of nonparametric IV regression," Quantitative Economics, Econometric Society, vol. 9(1), pages 39-84, March.
    8. Nishanth Dikkala & Greg Lewis & Lester Mackey & Vasilis Syrgkanis, 2020. "Minimax Estimation of Conditional Moment Models," Papers 2006.07201, arXiv.org.
    9. Brown, Bryan W & Newey, Whitney K, 2002. "Generalized Method of Moments, Efficient Bootstrapping, and Improved Inference," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(4), pages 507-517, October.
    10. Chen, Xiaohong & Hong, Han & Shum, Matthew, 2007. "Nonparametric likelihood ratio model selection tests between parametric likelihood and moment condition models," Journal of Econometrics, Elsevier, vol. 141(1), pages 109-140, November.
    11. Athey, Susan & Imbens, Guido W. & Metzger, Jonas & Munro, Evan, 2024. "Using Wasserstein Generative Adversarial Networks for the design of Monte Carlo simulations," Journal of Econometrics, Elsevier, vol. 240(2).
    12. Chen, Xiaohong, 2007. "Large Sample Sieve Estimation of Semi-Nonparametric Models," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 76, Elsevier.
    13. Richard Blundell & Joel L. Horowitz & Matthias Parey, 2012. "Measuring the price responsiveness of gasoline demand: Economic shape restrictions and nonparametric demand estimation," Quantitative Economics, Econometric Society, vol. 3(1), pages 29-51, March.
    14. Xiaohong Chen & Yin Jia Jeff Qiu, 2016. "Methods for Nonparametric and Semiparametric Regressions with Endogeneity: A Gentle Guide," Annual Review of Economics, Annual Reviews, vol. 8(1), pages 259-290, October.
    15. Chen, Xiaohong & Liao, Zhipeng, 2015. "Sieve semiparametric two-step GMM under weak dependence," Journal of Econometrics, Elsevier, vol. 189(1), pages 163-186.
    16. Tibor Neugebauer & Sascha F llbrunn, 2013. "Varying the number of bidders in the first-price sealed-bid auction: experimental evidence for the one-shot game," DEM Discussion Paper Series 13-10, Department of Economics at the University of Luxembourg.
    17. Wooldridge, Jeffrey M. & White, Halbert, 1988. "Some Invariance Principles and Central Limit Theorems for Dependent Heterogeneous Processes," Econometric Theory, Cambridge University Press, vol. 4(2), pages 210-230, August.
    18. Stinchcombe, Maxwell B. & White, Halbert, 1998. "Consistent Specification Testing With Nuisance Parameters Present Only Under The Alternative," Econometric Theory, Cambridge University Press, vol. 14(3), pages 295-325, June.
    19. Whitney K. Newey & James L. Powell, 2003. "Instrumental Variable Estimation of Nonparametric Models," Econometrica, Econometric Society, vol. 71(5), pages 1565-1578, September.
    20. Chunrong Ai & Xiaohong Chen, 2003. "Efficient Estimation of Models with Conditional Moment Restrictions Containing Unknown Functions," Econometrica, Econometric Society, vol. 71(6), pages 1795-1843, November.
    21. Xiaohong Chen & Timothy M. Christensen & Sid Kankanala, 2021. "Adaptive Estimation and Uniform Confidence Bands for Nonparametric IV," Cowles Foundation Discussion Papers 2292, Cowles Foundation for Research in Economics, Yale University.
    22. Chamberlain, Gary, 1992. "Sequential Moment Restrictions in Panel Data: Comment," Journal of Business & Economic Statistics, American Statistical Association, vol. 10(1), pages 20-26, January.
    23. Donald, Stephen G. & Imbens, Guido W. & Newey, Whitney K., 2003. "Empirical likelihood estimation and consistent tests with conditional moment restrictions," Journal of Econometrics, Elsevier, vol. 117(1), pages 55-93, November.
    24. Andres Santos, 2012. "Inference in Nonparametric Instrumental Variables With Partial Identification," Econometrica, Econometric Society, vol. 80(1), pages 213-275, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chen, Jiafeng & Chen, Xiaohong & Tamer, Elie, 2023. "Efficient estimation of average derivatives in NPIV models: Simulation comparisons of neural network estimators," Journal of Econometrics, Elsevier, vol. 235(2), pages 1848-1875.
    2. Jiafeng Chen & Xiaohong Chen & Elie Tamer, 2021. "Efficient Estimation of Average Derivatives in NPIV Models: Simulation Comparisons of Neural Network Estimators," Cowles Foundation Discussion Papers 2319, Cowles Foundation for Research in Economics, Yale University.
    3. Victor Chernozhukov & Whitney K. Newey & Andres Santos, 2023. "Constrained Conditional Moment Restriction Models," Econometrica, Econometric Society, vol. 91(2), pages 709-736, March.
    4. Liu, Lin & Mukherjee, Rajarshi & Robins, James M., 2024. "Assumption-lean falsification tests of rate double-robustness of double-machine-learning estimators," Journal of Econometrics, Elsevier, vol. 240(2).
    5. Zheng Fang & Juwon Seo, 2019. "A Projection Framework for Testing Shape Restrictions That Form Convex Cones," Papers 1910.07689, arXiv.org, revised Sep 2021.
    6. Wang, Ao, 2023. "Sieve BLP: A semi-nonparametric model of demand for differentiated products," Journal of Econometrics, Elsevier, vol. 235(2), pages 325-351.
    7. Hidehiko Ichimura & Whitney K. Newey, 2022. "The influence function of semiparametric estimators," Quantitative Economics, Econometric Society, vol. 13(1), pages 29-61, January.
    8. Jean-Jacques Forneron, 2019. "A Sieve-SMM Estimator for Dynamic Models," Papers 1902.01456, arXiv.org, revised Jan 2023.
    9. Ganesh Karapakula, 2023. "Stable Probability Weighting: Large-Sample and Finite-Sample Estimation and Inference Methods for Heterogeneous Causal Effects of Multivalued Treatments Under Limited Overlap," Papers 2301.05703, arXiv.org, revised Jan 2023.
    10. Victor Chernozhukov & Whitney Newey & Rahul Singh & Vasilis Syrgkanis, 2020. "Adversarial Estimation of Riesz Representers," Papers 2101.00009, arXiv.org, revised Apr 2024.
    11. Andrew Bennett & Nathan Kallus & Xiaojie Mao & Whitney Newey & Vasilis Syrgkanis & Masatoshi Uehara, 2022. "Inference on Strongly Identified Functionals of Weakly Identified Functions," Papers 2208.08291, arXiv.org, revised Jun 2023.
    12. Lu, Zhentong & Shi, Xiaoxia & Tao, Jing, 2023. "Semi-nonparametric estimation of random coefficients logit model for aggregate demand," Journal of Econometrics, Elsevier, vol. 235(2), pages 2245-2265.
    13. Breunig, Christoph & Mammen, Enno & Simoni, Anna, 2018. "Nonparametric estimation in case of endogenous selection," Journal of Econometrics, Elsevier, vol. 202(2), pages 268-285.
    14. Michael Jansson & Demian Pouzo, 2017. "Towards a General Large Sample Theory for Regularized Estimators," Papers 1712.07248, arXiv.org, revised Jul 2020.
    15. Yu Zhu, 2020. "Inference in nonparametric/semiparametric moment equality models with shape restrictions," Quantitative Economics, Econometric Society, vol. 11(2), pages 609-636, May.
    16. Ai, Chunrong & Chen, Xiaohong, 2012. "The semiparametric efficiency bound for models of sequential moment restrictions containing unknown functions," Journal of Econometrics, Elsevier, vol. 170(2), pages 442-457.
    17. Dong, Chaohua & Gao, Jiti & Linton, Oliver, 2023. "High dimensional semiparametric moment restriction models," Journal of Econometrics, Elsevier, vol. 232(2), pages 320-345.
    18. Chen, Xiaohong & Pouzo, Demian & Powell, James L., 2019. "Penalized sieve GEL for weighted average derivatives of nonparametric quantile IV regressions," Journal of Econometrics, Elsevier, vol. 213(1), pages 30-53.
    19. Breunig, Christoph & Mammen, Enno & Simoni, Anna, 2020. "Ill-posed estimation in high-dimensional models with instrumental variables," Journal of Econometrics, Elsevier, vol. 219(1), pages 171-200.
    20. Hoshino, Tadao, 2022. "Sieve IV estimation of cross-sectional interaction models with nonparametric endogenous effect," Journal of Econometrics, Elsevier, vol. 229(2), pages 263-275.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2110.06763. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.