IDEAS home Printed from https://ideas.repec.org/p/ifs/cemmap/17-08.html
   My bibliography  Save this paper

Improving point and interval estimates of monotone functions by rearrangement

Author

Listed:
  • Victor Chernozhukov

    (Institute for Fiscal Studies and MIT)

  • Ivan Fernandez-Val

    (Institute for Fiscal Studies and Boston University)

  • Alfred Galichon

    (Institute for Fiscal Studies and NYU)

Abstract

Suppose that a target function is monotonic, namely weakly increasing, and an original estimate of this target function is available, which is not weakly increasing. Many common estimation methods used in statistics produce such estimates. We show that these estimates can always be improved with no harm by using rearrangement techniques: The rearrangement methods, univariate and multivariate, transform the original estimate to a monotonic estimate, and the resulting estimate is closer to the true curve in common metrics than the original estimate. The improvement property of the rearrangement also extends to the construction of confidence bands for monotone functions. Let l and u be the lower and upper endpoint functions of a simultaneous confidence interval [l,u] that covers the true function with probability (1-a), then the rearranged confidence interval, defined by the rearranged lower and upper end-point functions, is shorter in length in common norms than the original interval and covers the true function with probability greater or equal to (1-a). We illustrate the results with a computational example and an empirical example dealing with age-height growth charts. Please note: This paper is a revised version of cemmap working Paper CWP09/07.

Suggested Citation

  • Victor Chernozhukov & Ivan Fernandez-Val & Alfred Galichon, 2008. "Improving point and interval estimates of monotone functions by rearrangement," CeMMAP working papers CWP17/08, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
  • Handle: RePEc:ifs:cemmap:17/08
    as

    Download full text from publisher

    File URL: http://cemmap.ifs.org.uk/wps/cwp1708.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Matzkin, Rosa L., 1986. "Restrictions of economic theory in nonparametric methods," Handbook of Econometrics, in: R. F. Engle & D. McFadden (ed.), Handbook of Econometrics, edition 1, volume 4, chapter 42, pages 2523-2558, Elsevier.
    2. Victor Chernozhukov & Ivan Fernandez-Val & Alfred Galichon, 2007. "Improving estimates of monotone functions by rearrangement," CeMMAP working papers CWP09/07, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    3. Andrews, Donald W K, 1991. "Asymptotic Normality of Series Estimators for Nonparametric and Semiparametric Regression Models," Econometrica, Econometric Society, vol. 59(2), pages 307-345, March.
    4. Youri Davydov & Ricardas Zitikis, 2005. "An index of monotonicity and its estimation: a step beyond econometric applications of the Gini index," Metron - International Journal of Statistics, Dipartimento di Statistica, Probabilità e Statistiche Applicate - University of Rome, vol. 0(3), pages 351-372.
    5. Gallant, A. Ronald, 1981. "On the bias in flexible functional forms and an essentially unbiased form : The fourier flexible form," Journal of Econometrics, Elsevier, vol. 15(2), pages 211-245, February.
    6. Koenker,Roger, 2005. "Quantile Regression," Cambridge Books, Cambridge University Press, number 9780521845731.
    7. Newey, Whitney K., 1997. "Convergence rates and asymptotic normality for series estimators," Journal of Econometrics, Elsevier, vol. 79(1), pages 147-168, July.
    8. Koenker, Roger W & Bassett, Gilbert, Jr, 1978. "Regression Quantiles," Econometrica, Econometric Society, vol. 46(1), pages 33-50, January.
    9. He, Xuming & Shao, Qi-Man, 2000. "On Parameters of Increasing Dimensions," Journal of Multivariate Analysis, Elsevier, vol. 73(1), pages 120-135, April.
    10. T. J. Cole, 1988. "Fitting Smoothed Centile Curves to Reference Data," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 151(3), pages 385-406, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Belloni, Alexandre & Chernozhukov, Victor & Chetverikov, Denis & Fernández-Val, Iván, 2019. "Conditional quantile processes based on series or many regressors," Journal of Econometrics, Elsevier, vol. 213(1), pages 4-29.
    2. Chen, Xiaohong & Liao, Zhipeng, 2014. "Sieve M inference on irregular parameters," Journal of Econometrics, Elsevier, vol. 182(1), pages 70-86.
    3. Tadao Hoshino, 2014. "Quantile regression estimation of partially linear additive models," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 26(3), pages 509-536, September.
    4. Cui, Xia & Zhao, Weihua & Lian, Heng & Liang, Hua, 2019. "Pursuit of dynamic structure in quantile additive models with longitudinal data," Computational Statistics & Data Analysis, Elsevier, vol. 130(C), pages 42-60.
    5. Su, Liangjun & Hoshino, Tadao, 2016. "Sieve instrumental variable quantile regression estimation of functional coefficient models," Journal of Econometrics, Elsevier, vol. 191(1), pages 231-254.
    6. Qi Li & Jeffrey Scott Racine, 2006. "Nonparametric Econometrics: Theory and Practice," Economics Books, Princeton University Press, edition 1, volume 1, number 8355.
    7. Ichimura, Hidehiko & Todd, Petra E., 2007. "Implementing Nonparametric and Semiparametric Estimators," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 74, Elsevier.
    8. repec:hal:wpspec:info:hdl:2441/5rkqqmvrn4tl22s9mc4b6ga2g is not listed on IDEAS
    9. Zhang, Linwan & Wu, Weixing & Wei, Ying & Pan, Rulu, 2015. "Stock holdings over the life cycle: Who hesitates to join the market?," Economic Systems, Elsevier, vol. 39(3), pages 423-438.
    10. Chernozhukov, Victor & Hansen, Christian & Jansson, Michael, 2009. "Finite sample inference for quantile regression models," Journal of Econometrics, Elsevier, vol. 152(2), pages 93-103, October.
    11. Blundell, Richard & Kristensen, Dennis & Matzkin, Rosa, 2014. "Bounding quantile demand functions using revealed preference inequalities," Journal of Econometrics, Elsevier, vol. 179(2), pages 112-127.
    12. Park, Seyoung & Lee, Eun Ryung, 2021. "Hypothesis testing of varying coefficients for regional quantiles," Computational Statistics & Data Analysis, Elsevier, vol. 159(C).
    13. Daniel J. Henderson & Christopher F. Parmeter, 2009. "Imposing economic constraints in nonparametric regression: survey, implementation, and extension," Advances in Econometrics, in: Nonparametric Econometric Methods, pages 433-469, Emerald Group Publishing Limited.
    14. Li, Jia & Liao, Zhipeng, 2020. "Uniform nonparametric inference for time series," Journal of Econometrics, Elsevier, vol. 219(1), pages 38-51.
    15. Ai, Chunrong & Linton, Oliver & Zhang, Zheng, 2022. "Estimation and inference for the counterfactual distribution and quantile functions in continuous treatment models," Journal of Econometrics, Elsevier, vol. 228(1), pages 39-61.
    16. repec:hal:spmain:info:hdl:2441/5rkqqmvrn4tl22s9mc4b6ga2g is not listed on IDEAS
    17. He, Xuming & Pan, Xiaoou & Tan, Kean Ming & Zhou, Wen-Xin, 2023. "Smoothed quantile regression with large-scale inference," Journal of Econometrics, Elsevier, vol. 232(2), pages 367-388.
    18. Nicholas C.S. Sim, 2009. "Modeling Quantile Dependence: A New Look at the Money-Output Relationship," School of Economics and Public Policy Working Papers 2009-34, University of Adelaide, School of Economics and Public Policy.
    19. repec:spo:wpmain:info:hdl:2441/5rkqqmvrn4tl22s9mc4b6ga2g is not listed on IDEAS
    20. Lin, Fangzheng & Tang, Yanlin & Zhu, Zhongyi, 2020. "Weighted quantile regression in varying-coefficient model with longitudinal data," Computational Statistics & Data Analysis, Elsevier, vol. 145(C).
    21. Chen, Xiaohong, 2007. "Large Sample Sieve Estimation of Semi-Nonparametric Models," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 76, Elsevier.
    22. Wang, Chuchu & Song, Xinyuan, 2024. "Nonparametric quantile scalar-on-image regression," Computational Statistics & Data Analysis, Elsevier, vol. 191(C).
    23. Victor Chernozhukov & Denis Chetverikov & Kengo Kato, 2012. "Gaussian approximation of suprema of empirical processes," CeMMAP working papers 44/12, Institute for Fiscal Studies.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ifs:cemmap:17/08. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Emma Hyman (email available below). General contact details of provider: https://edirc.repec.org/data/cmifsuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.