IDEAS home Printed from https://ideas.repec.org/a/inm/oropre/v60y2012i1p196-208.html
   My bibliography  Save this article

Consistency of Multidimensional Convex Regression

Author

Listed:
  • Eunji Lim

    (Department of Industrial Engineering, University of Miami, Coral Gables, Florida 33124)

  • Peter W. Glynn

    (Department of Management Science and Engineering, Stanford University, Stanford, California 94305)

Abstract

Convex regression is concerned with computing the best fit of a convex function to a data set of n observations in which the independent variable is (possibly) multidimensional. Such regression problems arise in operations research, economics, and other disciplines in which imposing a convexity constraint on the regression function is natural. This paper studies a least-squares estimator that is computable as the solution of a quadratic program and establishes that it converges almost surely to the “true” function as n (rightarrow) (infinity) under modest technical assumptions. In addition to this multidimensional consistency result, we identify the behavior of the estimator when the model is misspecified (so that the “true” function is nonconvex), and we extend the consistency result to settings in which the function must be both convex and nondecreasing (as is needed for consumer preference utility functions).

Suggested Citation

  • Eunji Lim & Peter W. Glynn, 2012. "Consistency of Multidimensional Convex Regression," Operations Research, INFORMS, vol. 60(1), pages 196-208, February.
    • Handle: RePEc:inm:oropre:v:60:y:2012:i:1:p:196-208
    DOI: 10.1287/opre.1110.1007
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/opre.1110.1007
    Download Restriction: no
    File URL: https://libkey.io/10.1287/opre.1110.1007?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Adonis Yatchew & Len Bos, 1997. "Nonparametric Least Squares Regression and Testing in Economic Models," Working Papers yatchew-99-01, University of Toronto, Department of Economics.
    2. Timo Kuosmanen, 2008. "Representation theorem for convex nonparametric least squares," Econometrics Journal, Royal Economic Society, vol. 11(2), pages 308-325, July.
    3. Varian, Hal R, 1984. "The Nonparametric Approach to Production Analysis," Econometrica, Econometric Society, vol. 52(3), pages 579-597, May.
    4. Gad Allon & Michael Beenstock & Steven Hackman & Ury Passy & Alexander Shapiro, 2007. "Nonparametric estimation of concave production technologies by entropic methods," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 22(4), pages 795-816.
    5. Varian, Hal R., 1985. "Non-parametric analysis of optimizing behavior with measurement error," Journal of Econometrics, Elsevier, vol. 30(1-2), pages 445-458.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ruitu Xu & Yifei Min & Tianhao Wang & Zhaoran Wang & Michael I. Jordan & Zhuoran Yang, 2023. "Finding Regularized Competitive Equilibria of Heterogeneous Agent Macroeconomic Models with Reinforcement Learning," Papers 2303.04833, arXiv.org.
    2. Nanjing Jian & Shane G. Henderson, 2020. "Estimating the Probability that a Function Observed with Noise Is Convex," INFORMS Journal on Computing, INFORMS, vol. 32(2), pages 376-389, April.
    3. Yining Chen & Richard J. Samworth, 2016. "Generalized additive and index models with shape constraints," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 78(4), pages 729-754, September.
    4. Peter W. Glynn & Yijie Peng & Michael C. Fu & Jian-Qiang Hu, 2021. "Computing Sensitivities for Distortion Risk Measures," INFORMS Journal on Computing, INFORMS, vol. 33(4), pages 1520-1532, October.
    5. Kuosmanen, Timo & Johnson, Andrew, 2017. "Modeling joint production of multiple outputs in StoNED: Directional distance function approach," European Journal of Operational Research, Elsevier, vol. 262(2), pages 792-801.
    6. Eunji Lim, 2014. "On Convergence Rates of Convex Regression in Multiple Dimensions," INFORMS Journal on Computing, INFORMS, vol. 26(3), pages 616-628, August.
    7. Ryan Cory-Wright & Cristina Cornelio & Sanjeeb Dash & Bachir El Khadir & Lior Horesh, 2024. "Evolving scientific discovery by unifying data and background knowledge with AI Hilbert," Nature Communications, Nature, vol. 15(1), pages 1-14, December.
    8. Chen, Yining & S. Torrent, Hudson & A. Ziegelmann, Flavio, 2023. "Robust nonparametric frontier estimation in two steps," LSE Research Online Documents on Economics 119389, London School of Economics and Political Science, LSE Library.
    9. Dimitris Bertsimas & Nishanth Mundru, 2021. "Sparse Convex Regression," INFORMS Journal on Computing, INFORMS, vol. 33(1), pages 262-279, January.
    10. Wang, Yongqiao & Wang, Shouyang & Dang, Chuangyin & Ge, Wenxiu, 2014. "Nonparametric quantile frontier estimation under shape restriction," European Journal of Operational Research, Elsevier, vol. 232(3), pages 671-678.
    11. Dai, Sheng & Kuosmanen, Timo & Zhou, Xun, 2023. "Generalized quantile and expectile properties for shape constrained nonparametric estimation," European Journal of Operational Research, Elsevier, vol. 310(2), pages 914-927.
    12. Zhiqiang Liao, 2024. "Variable selection in convex nonparametric least squares via structured Lasso: An application to the Swedish electricity distribution networks," Papers 2409.01911, arXiv.org, revised Nov 2024.
    13. Ghosal, Rahul & Ghosh, Sujit & Urbanek, Jacek & Schrack, Jennifer A. & Zipunnikov, Vadim, 2023. "Shape-constrained estimation in functional regression with Bernstein polynomials," Computational Statistics & Data Analysis, Elsevier, vol. 178(C).
    14. Bodhisattva Sen & Mary Meyer, 2017. "Testing against a linear regression model using ideas from shape-restricted estimation," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(2), pages 423-448, March.
    15. Lee, Chia-Yen & Johnson, Andrew L. & Moreno-Centeno, Erick & Kuosmanen, Timo, 2013. "A more efficient algorithm for Convex Nonparametric Least Squares," European Journal of Operational Research, Elsevier, vol. 227(2), pages 391-400.
    16. Julia Schaefer & Marcel Clermont, 2018. "Stochastic non-smooth envelopment of data for multi-dimensional output," Journal of Productivity Analysis, Springer, vol. 50(3), pages 139-154, December.
    17. Henry Lam & Clementine Mottet, 2017. "Tail Analysis Without Parametric Models: A Worst-Case Perspective," Operations Research, INFORMS, vol. 65(6), pages 1696-1711, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Eunji Lim, 2014. "On Convergence Rates of Convex Regression in Multiple Dimensions," INFORMS Journal on Computing, INFORMS, vol. 26(3), pages 616-628, August.
    2. Kuosmanen, Timo & Johnson, Andrew, 2017. "Modeling joint production of multiple outputs in StoNED: Directional distance function approach," European Journal of Operational Research, Elsevier, vol. 262(2), pages 792-801.
    3. Gad Allon & Michael Beenstock & Steven Hackman & Ury Passy & Alexander Shapiro, 2007. "Nonparametric estimation of concave production technologies by entropic methods," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 22(4), pages 795-816.
    4. Timo Kuosmanen & Mogens Fosgerau, 2009. "Neoclassical versus Frontier Production Models? Testing for the Skewness of Regression Residuals," Scandinavian Journal of Economics, Wiley Blackwell, vol. 111(2), pages 351-367, June.
    5. Mike G. Tsionas & Valentin Zelenyuk, 2022. "Testing for Optimization Behavior in Production when Data is with Measurement Errors: A Bayesian Approach," CEPA Working Papers Series WP012022, School of Economics, University of Queensland, Australia.
    6. Subhash C. Ray, 2004. "A Simple Statistical Test of Violation of the Weak Axiom of Cost Minimization," Indian Economic Review, Department of Economics, Delhi School of Economics, vol. 39(1), pages 111-121, January.
    7. Cherchye, L. & Post, G.T., 2001. "Methodological Advances in Dea," ERIM Report Series Research in Management ERS-2001-53-F&A, Erasmus Research Institute of Management (ERIM), ERIM is the joint research institute of the Rotterdam School of Management, Erasmus University and the Erasmus School of Economics (ESE) at Erasmus University Rotterdam.
    8. Indraneel Dasgupta, 2005. "Consistent firm choice and the theory of supply," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 26(1), pages 167-175, July.
    9. Sundström, David, 2016. "On Specification and Inference in the Econometrics of Public Procurement," Umeå Economic Studies 931, Umeå University, Department of Economics.
    10. Tsionas, Mike G. & Izzeldin, Marwan, 2018. "Smooth approximations to monotone concave functions in production analysis: An alternative to nonparametric concave least squares," European Journal of Operational Research, Elsevier, vol. 271(3), pages 797-807.
    11. Thomas Demuynck & John Rehbeck, 2023. "Computing revealed preference goodness-of-fit measures with integer programming," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 76(4), pages 1175-1195, November.
    12. Dimitris Bertsimas & Nishanth Mundru, 2021. "Sparse Convex Regression," INFORMS Journal on Computing, INFORMS, vol. 33(1), pages 262-279, January.
    13. Carvajal, Andres & Ray, Indrajit & Snyder, Susan, 2004. "Equilibrium behavior in markets and games: testable restrictions and identification," Journal of Mathematical Economics, Elsevier, vol. 40(1-2), pages 1-40, February.
    14. H. Spencer Banzhaf & Yaqin Liu & Martin Smith & Frank Asche, 2019. "Non-Parametric Tests of the Tragedy of the Commons," NBER Working Papers 26398, National Bureau of Economic Research, Inc.
    15. Cherchye, Laurens & Demuynck, Thomas & De Rock, Bram & Hjertstrand, Per, 2015. "Revealed preference tests for weak separability: An integer programming approach," Journal of Econometrics, Elsevier, vol. 186(1), pages 129-141.
    16. Bar-Shira, Ziv & Finkelshtain, Israel, 1997. "Nonparametric analysis of pooled production data," Economics Letters, Elsevier, vol. 55(2), pages 173-178, August.
    17. Tsionas, Mike G., 2021. "Optimal combinations of stochastic frontier and data envelopment analysis models," European Journal of Operational Research, Elsevier, vol. 294(2), pages 790-800.
    18. Kuosmanen, Timo & Post, Thierry & Scholtes, Stefan, 2007. "Non-parametric tests of productive efficiency with errors-in-variables," Journal of Econometrics, Elsevier, vol. 136(1), pages 131-162, January.
    19. Leleu, Hervé, 2013. "Inner and outer approximations of technology: A shadow profit approach," Omega, Elsevier, vol. 41(5), pages 868-871.
    20. Crooker, John & Kling, Catherine L., 2000. "Nonparametric Bounds on Welfare Measures: A New Tool for Nonmarket Valuation," Journal of Environmental Economics and Management, Elsevier, vol. 39(2), pages 145-161, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:oropre:v:60:y:2012:i:1:p:196-208. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.