IDEAS home Printed from https://ideas.repec.org/p/zbw/sfb373/199926.html
   My bibliography  Save this paper

A simple variable selection technique for nonlinear models

Author

Listed:
  • Rech, Gianluigi
  • Teräsvirta, Timo
  • Tschernig, Rolf

Abstract

Applying nonparametric variable selection criteria in nonlinear regression models generally requires a substantial computational effort if the data set is large. In this paper we present a selection technique that is computationally much less demanding and performs well in comparison with methods currently available. It is based on a Taylor expansion of the nonlinear model around a given point in the sample space. Performing the selection only requires repeated least squares estimation of models that are linear in parameters. The main limitation of the method is that the number of variables among which to select cannot be very large if the sample is small and an adequate Taylor expansion is of high order. Large samples can be handled without problems.

Suggested Citation

  • Rech, Gianluigi & Teräsvirta, Timo & Tschernig, Rolf, 1999. "A simple variable selection technique for nonlinear models," SFB 373 Discussion Papers 1999,26, Humboldt University of Berlin, Interdisciplinary Research Project 373: Quantification and Simulation of Economic Processes.
    • Handle: RePEc:zbw:sfb373:199926
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/61750/1/722251718.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Yao, Qiwei & Tong, Howell, 1994. "On subset selection in non-parametric stochastic regression," LSE Research Online Documents on Economics 6409, London School of Economics and Political Science, LSE Library.
    2. Hirotugu Akaike, 1969. "Fitting autoregressive models for prediction," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 21(1), pages 243-247, December.
    3. Tschernig, Rolf & Yang, Lijian, 1997. "Nonparametric lag selection for time series," SFB 373 Discussion Papers 1997,59, Humboldt University of Berlin, Interdisciplinary Research Project 373: Quantification and Simulation of Economic Processes.
    4. Rolf Tschernig & Lijian Yang, 2000. "Nonparametric Lag Selection for Time Series," Journal of Time Series Analysis, Wiley Blackwell, vol. 21(4), pages 457-487, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Marcelo C. Medeiros & Alvaro Veiga, 2003. "Diagnostic Checking in a Flexible Nonlinear Time Series Model," Journal of Time Series Analysis, Wiley Blackwell, vol. 24(4), pages 461-482, July.
    2. Marcelo Cunha Medeiros & Álvaro Veiga & Carlos Eduardo Pedreira, 2000. "Modelling exchange rates: smooth transitions, neural networks, and linear models," Textos para discussão 432, Department of Economics PUC-Rio (Brazil).
    3. Marie Lebreton & Katia Melnik, 2009. "Voluntary Participation as a Determinant of Social Capital in France : Allowing for Parameter Heterogeneity," Working Papers halshs-00410530, HAL.
    4. Eduardo Mendes & Alvaro Veiga & MArcelo Cunha Medeiros, 2007. "Estimation And Asymptotic Theory For A New Class Of Mixture Models," Textos para discussão 538, Department of Economics PUC-Rio (Brazil).
    5. Henrik Amilon, 2003. "A neural network versus Black-Scholes: a comparison of pricing and hedging performances," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 22(4), pages 317-335.
    6. Barrera, Carlos R., 2010. "Redes neuronales para predecir el tipo de cambio diario," Working Papers 2010-001, Banco Central de Reserva del Perú.
    7. Lebreton, Marie, 2005. "The NCSTAR model as an alternative to the GWR model," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 355(1), pages 77-84.
    8. Terasvirta, Timo & van Dijk, Dick & Medeiros, Marcelo C., 2005. "Linear models, smooth transition autoregressions, and neural networks for forecasting macroeconomic time series: A re-examination," International Journal of Forecasting, Elsevier, vol. 21(4), pages 755-774.
    9. Timo Teräsvirta & Marcelo C. Medeiros & Gianluigi Rech, 2006. "Building neural network models for time series: a statistical approach," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 25(1), pages 49-75.
    10. Marcelo C. Medeiros & Eduardo F. Mendes, 2015. "l1-Regularization of High-Dimensional Time-Series Models with Flexible Innovations," Textos para discussão 636, Department of Economics PUC-Rio (Brazil).
    11. Péguin-Feissolle, Anne & Strikholm, Birgit & Teräsvirta, Timo, 2007. "Testing the Granger noncausality hypothesis in stationary nonlinear models of unknown functional form," SSE/EFI Working Paper Series in Economics and Finance 672, Stockholm School of Economics, revised 18 Jan 2012.
    12. Mayte Suarez -Farinas & Carlos E. Pedreira & Marcelo C. Medeiros, 2004. "Local Global Neural Networks: A New Approach for Nonlinear Time Series Modeling," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 1092-1107, December.
    13. Murat Midilic, 2016. "Estimation Of Star-Garch Models With Iteratively Weighted Least Squares," Working Papers of Faculty of Economics and Business Administration, Ghent University, Belgium 16/918, Ghent University, Faculty of Economics and Business Administration.
    14. Medeiros, Marcelo & Veiga, Alvaro, 2000. "A Flexible Coefficient Smooth Transition Time Series Model," SSE/EFI Working Paper Series in Economics and Finance 360, Stockholm School of Economics, revised 29 Apr 2004.
    15. MArcelo C. Medeiros & Eduardo F.Mendes, 2012. "Estimating High-Dimensional Time Series Models," Textos para discussão 602, Department of Economics PUC-Rio (Brazil).
    16. McAleer, Michael & Medeiros, Marcelo C., 2008. "A multiple regime smooth transition Heterogeneous Autoregressive model for long memory and asymmetries," Journal of Econometrics, Elsevier, vol. 147(1), pages 104-119, November.
    17. Leila Ali & Marie Lebreton, 2013. "The Fall of Bretton Woods: Which Geography Matters?," Economics Bulletin, AccessEcon, vol. 33(2), pages 1396-1419.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rolf Tschernig & Lijian Yang, 2000. "Nonparametric Estimation of Generalized Impulse Response Functions," Econometric Society World Congress 2000 Contributed Papers 1417, Econometric Society.
    2. Guo, Zheng-Feng & Shintani, Mototsugu, 2011. "Nonparametric lag selection for nonlinear additive autoregressive models," Economics Letters, Elsevier, vol. 111(2), pages 131-134, May.
    3. Miao Yang & Lan Xue & Lijian Yang, 2016. "Variable selection for additive model via cumulative ratios of empirical strengths total," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 28(3), pages 595-616, September.
    4. Timo Teräsvirta & Marcelo C. Medeiros & Gianluigi Rech, 2006. "Building neural network models for time series: a statistical approach," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 25(1), pages 49-75.
    5. Lütkepohl,Helmut & Krätzig,Markus (ed.), 2004. "Applied Time Series Econometrics," Cambridge Books, Cambridge University Press, number 9780521547871, November.
    6. Zhou, Yunzhe & Shi, Chengchun & Li, Lexin & Yao, Qiwei, 2023. "Testing for the Markov property in time series via deep conditional generative learning," LSE Research Online Documents on Economics 119352, London School of Economics and Political Science, LSE Library.
    7. Lijian Yang & Wolfgang Hardle & Jens Nielsen, 1999. "Nonparametric Autoregression with Multiplicative Volatility and Additive mean," Journal of Time Series Analysis, Wiley Blackwell, vol. 20(5), pages 579-604, September.
    8. Wolfgang Härdle & Torsten Kleinow & Rolf Tschernig, 2001. "Web Quantlets for Time Series Analysis," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 53(1), pages 179-188, March.
    9. Rolf Tschernig & Lijian Yang, 2000. "Nonparametric Lag Selection for Time Series," Journal of Time Series Analysis, Wiley Blackwell, vol. 21(4), pages 457-487, July.
    10. Mohamed Chikhi & Claude Diebolt, 2010. "Nonparametric analysis of financial time series by the Kernel methodology," Quality & Quantity: International Journal of Methodology, Springer, vol. 44(5), pages 865-880, August.
    11. Shintani, Mototsugu, 2008. "A dynamic factor approach to nonlinear stability analysis," Journal of Economic Dynamics and Control, Elsevier, vol. 32(9), pages 2788-2808, September.
    12. Stanislav Anatolyev, 2007. "Optimal Instruments In Time Series: A Survey," Journal of Economic Surveys, Wiley Blackwell, vol. 21(1), pages 143-173, February.
    13. Su, Liangjun & White, Halbert, 2007. "A consistent characteristic function-based test for conditional independence," Journal of Econometrics, Elsevier, vol. 141(2), pages 807-834, December.
    14. Cees Diks & Sebastiano Manzan, 2001. "Tests for Serial Independence and Linearity based on Correlation Integrals," Tinbergen Institute Discussion Papers 01-085/1, Tinbergen Institute.
    15. Sami MESTIRI, 2022. "Modeling the volatility of Bitcoin returns using Nonparametric GARCH models," Journal of Academic Finance, RED research unit, university of Gabes, Tunisia, vol. 13(1), pages 2-16, June.
    16. Diks Cees & Manzan Sebastiano, 2002. "Tests for Serial Independence and Linearity Based on Correlation Integrals," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 6(2), pages 1-22, July.
    17. Stanislav Anatolyev, 2009. "Nonparametric regression (in Russian)," Quantile, Quantile, issue 7, pages 37-52, September.
    18. Gao, Jiti, 2007. "Nonlinear time series: semiparametric and nonparametric methods," MPRA Paper 39563, University Library of Munich, Germany, revised 01 Sep 2007.
    19. Chevallier, Julien, 2011. "Nonparametric modeling of carbon prices," Energy Economics, Elsevier, vol. 33(6), pages 1267-1282.
    20. Inés Barbeito & Ricardo Cao & Stefan Sperlich, 2023. "Bandwidth selection for statistical matching and prediction," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 32(1), pages 418-446, March.

    More about this item

    Keywords

    nonlinear regression; Autoregression; nonlinear time series; nonparametric variable selection; time series modelling;
    All these keywords.

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:sfb373:199926. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/sfhubde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.