IDEAS home Printed from https://ideas.repec.org/p/pra/mprapa/11975.html
   My bibliography  Save this paper

Semiparametric penalty function method in partially linear model selection

Author

Listed:
  • Dong, Chaohua
  • Gao, Jiti
  • Tong, Howell

Abstract

Model selection in nonparametric and semiparametric regression is of both theoretical and practical interest. Gao and Tong (2004) proposed a semiparametric leave–more–out cross–validation selection procedure for the choice of both the parametric and nonparametric regressors in a nonlinear time series regression model. As recognized by the authors, the implementation of the proposed procedure requires the availability of relatively large sample sizes. In order to address the model selection problem with small or medium sample sizes, we propose a model selection procedure for practical use. By extending the so–called penalty function method proposed in Zheng and Loh (1995, 1997) through the incorporation of features of the leave-one-out cross-validation approach, we develop a semiparametric, consistent selection procedure suitable for the choice of optimum subsets in a partially linear model. The newly proposed method is implemented using the full set of data, and simulations show that it works well for both small and medium sample sizes.

Suggested Citation

  • Dong, Chaohua & Gao, Jiti & Tong, Howell, 2006. "Semiparametric penalty function method in partially linear model selection," MPRA Paper 11975, University Library of Munich, Germany, revised Aug 2006.
    • Handle: RePEc:pra:mprapa:11975
    as

    Download full text from publisher

    File URL: https://mpra.ub.uni-muenchen.de/11975/1/MPRA_paper_11975.pdf
    File Function: original version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Hardle, W. & Hall, P. & Marron, J., 1990. "Regression smoothing parameters that are not far from their optimum," LIDAM Discussion Papers CORE 1990009, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    2. Jiti Gao & Howell Tong, 2004. "Semiparametric non‐linear time series model selection," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 66(2), pages 321-336, May.
    3. Yao, Qiwei & Tong, Howell, 1994. "On subset selection in non-parametric stochastic regression," LSE Research Online Documents on Economics 6409, London School of Economics and Political Science, LSE Library.
    4. Masry, Elias & Tjøstheim, Dag, 1995. "Nonparametric Estimation and Identification of Nonlinear ARCH Time Series Strong Convergence and Asymptotic Normality: Strong Convergence and Asymptotic Normality," Econometric Theory, Cambridge University Press, vol. 11(2), pages 258-289, February.
    5. Masry, Elias & Tjøstheim, Dag, 1997. "Additive Nonlinear ARX Time Series and Projection Estimates," Econometric Theory, Cambridge University Press, vol. 13(2), pages 214-252, April.
    6. Hardle, Wolfgang & LIang, Hua & Gao, Jiti, 2000. "Partially linear models," MPRA Paper 39562, University Library of Munich, Germany, revised 01 Sep 2000.
    7. Gao, Jiti & Tong, Howell, 2002. "Nonparametric and semiparametric regression model selection," MPRA Paper 11987, University Library of Munich, Germany, revised Feb 2004.
    8. Vieu, Philippe, 1994. "Choice of regressors in nonparametric estimation," Computational Statistics & Data Analysis, Elsevier, vol. 17(5), pages 575-594, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Gao, Jiti, 2007. "Nonlinear time series: semiparametric and nonparametric methods," MPRA Paper 39563, University Library of Munich, Germany, revised 01 Sep 2007.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gao, Jiti & Tong, Howell, 2002. "Nonparametric and semiparametric regression model selection," MPRA Paper 11987, University Library of Munich, Germany, revised Feb 2004.
    2. Gao, Jiti, 2007. "Nonlinear time series: semiparametric and nonparametric methods," MPRA Paper 39563, University Library of Munich, Germany, revised 01 Sep 2007.
    3. Gao, Jiti & Tong, Howell & Wolff, Rodney, 2002. "Model Specification Tests in Nonparametric Stochastic Regression Models," Journal of Multivariate Analysis, Elsevier, vol. 83(2), pages 324-359, November.
    4. Hardle, Wolfgang & LIang, Hua & Gao, Jiti, 2000. "Partially linear models," MPRA Paper 39562, University Library of Munich, Germany, revised 01 Sep 2000.
    5. Yang, Lijian & Park, Byeong U. & Xue, Lan & Hardle, Wolfgang, 2006. "Estimation and Testing for Varying Coefficients in Additive Models With Marginal Integration," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1212-1227, September.
    6. repec:hum:wpaper:sfb649dp2005-047 is not listed on IDEAS
    7. Patrick Saart & Jiti Gao & Nam Hyun Kim, 2014. "Semiparametric methods in nonlinear time series analysis: a selective review," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 26(1), pages 141-169, March.
    8. Rolf Tschernig & Lijian Yang, 2000. "Nonparametric Estimation of Generalized Impulse Response Functions," Econometric Society World Congress 2000 Contributed Papers 1417, Econometric Society.
    9. Cai, Zongwu, 2003. "Nonparametric estimation equations for time series data," Statistics & Probability Letters, Elsevier, vol. 62(4), pages 379-390, May.
    10. Fakoor, V., 2010. "Strong uniform consistency of kernel density estimators under a censored dependent model," Statistics & Probability Letters, Elsevier, vol. 80(5-6), pages 318-323, March.
    11. Linton, Oliver & Mammen, Enno, 2003. "Estimating semiparametric ARCH (8) models by kernel smoothing methods," LSE Research Online Documents on Economics 2187, London School of Economics and Political Science, LSE Library.
    12. Cai, Zongwu & Xu, Xiaoping, 2009. "Nonparametric Quantile Estimations for Dynamic Smooth Coefficient Models," Journal of the American Statistical Association, American Statistical Association, vol. 104(485), pages 371-383.
    13. Kim, Woocheol & Linton, Oliver, 2003. "A local instrumental variable estimation method for generalized additive volatility models," LSE Research Online Documents on Economics 2028, London School of Economics and Political Science, LSE Library.
    14. Jürgen Franke & Peter Mwita & Weining Wang, 2015. "Nonparametric estimates for conditional quantiles of time series," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 99(1), pages 107-130, January.
    15. Xialu Liu & Zongwu Cai & Rong Chen, 2015. "Functional coefficient seasonal time series models with an application of Hawaii tourism data," Computational Statistics, Springer, vol. 30(3), pages 719-744, September.
    16. repec:hum:wpaper:sfb649dp2014-012 is not listed on IDEAS
    17. Gao, Jiti, 2012. "Identification, Estimation and Specification in a Class of Semi-Linear Time Series Models," MPRA Paper 39256, University Library of Munich, Germany, revised 14 May 2012.
    18. O. Linton & E. Mammen, 2005. "Estimating Semiparametric ARCH(∞) Models by Kernel Smoothing Methods," Econometrica, Econometric Society, vol. 73(3), pages 771-836, May.
    19. Karlsen, Hans Arnfinn & Tjostheim, Dag, 1998. "Nonparametric estimation in null recurrent times series," SFB 373 Discussion Papers 1998,50, Humboldt University of Berlin, Interdisciplinary Research Project 373: Quantification and Simulation of Economic Processes.
    20. Li, Shu & Ernest, Jan & Bühlmann, Peter, 2017. "Nonparametric causal inference from observational time series through marginal integration," Econometrics and Statistics, Elsevier, vol. 2(C), pages 81-105.
    21. Lütkepohl,Helmut & Krätzig,Markus (ed.), 2004. "Applied Time Series Econometrics," Cambridge Books, Cambridge University Press, number 9780521547871, November.
    22. Haiyan Wang & Michael Akritas, 2010. "Inference from heteroscedastic functional data," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 22(2), pages 149-168.

    More about this item

    Keywords

    Linear model; model selection; nonparametric method; partially linear model; semiparametric method;
    All these keywords.

    JEL classification:

    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pra:mprapa:11975. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Joachim Winter (email available below). General contact details of provider: https://edirc.repec.org/data/vfmunde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.