IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v55y2011i7p2276-2287.html
   My bibliography  Save this article

Classification in segmented regression problems

Author

Listed:
  • Chen, Cathy W.S.
  • Chan, Jennifer S.K.
  • So, Mike K.P.
  • Lee, Kevin K.M.

Abstract

Heterogeneity in many datasets stems from the different behaviors of several underlying groups or subpopulations. The aim of this paper is to classify observations in such a dataset into these latent groups when each group's behavior is piecewise linearly related to a set of covariates. We assume that each group can be represented by a segmented regression model, but the group membership for each observation is unobserved or lost. A full Bayesian approach is proposed to simultaneously classify observations and estimate segmented regression parameters. The estimated marginal likelihood and the Deviance Information Criterion are used to select the number of mixture groups. We demonstrate the accuracy and performance of the proposed MCMC estimators in a simulation study and illustrate the methodology in an empirical study.

Suggested Citation

  • Chen, Cathy W.S. & Chan, Jennifer S.K. & So, Mike K.P. & Lee, Kevin K.M., 2011. "Classification in segmented regression problems," Computational Statistics & Data Analysis, Elsevier, vol. 55(7), pages 2276-2287, July.
    • Handle: RePEc:eee:csdana:v:55:y:2011:i:7:p:2276-2287
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167-9473(11)00031-4
    Download Restriction: Full text for ScienceDirect subscribers only.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ulrich Menzefricke, 1981. "A Bayesian Analysis of a Change in the Precision of a Sequence of Independent Normal Random Variables at an Unknown Time Point," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 30(2), pages 141-146, June.
    2. Albert, James H & Chib, Siddhartha, 1993. "Bayes Inference via Gibbs Sampling of Autoregressive Time Series Subject to Markov Mean and Variance Shifts," Journal of Business & Economic Statistics, American Statistical Association, vol. 11(1), pages 1-15, January.
    3. Jushan Bai, 1997. "Estimation Of A Change Point In Multiple Regression Models," The Review of Economics and Statistics, MIT Press, vol. 79(4), pages 551-563, November.
    4. Ram C. Tiwari & Kathleen A. Cronin & William Davis & Eric J. Feuer & Binbing Yu & Siddhartha Chib, 2005. "Bayesian model selection for join point regression with application to age‐adjusted cancer rates," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 54(5), pages 919-939, November.
    5. Chib, Siddhartha, 1998. "Estimation and comparison of multiple change-point models," Journal of Econometrics, Elsevier, vol. 86(2), pages 221-241, June.
    6. Chib, Siddhartha, 1996. "Calculating posterior distributions and modal estimates in Markov mixture models," Journal of Econometrics, Elsevier, vol. 75(1), pages 79-97, November.
    7. Chen, Cathy W.S. & So, Mike K.P., 2006. "On a threshold heteroscedastic model," International Journal of Forecasting, Elsevier, vol. 22(1), pages 73-89.
    8. Gary Koop & Simon M. Potter, 2007. "Estimation and Forecasting in Models with Multiple Breaks," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 74(3), pages 763-789.
    9. Leisch, Friedrich, 2004. "FlexMix: A General Framework for Finite Mixture Models and Latent Class Regression in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 11(i08).
    10. David J. Spiegelhalter & Nicola G. Best & Bradley P. Carlin & Angelika Van Der Linde, 2002. "Bayesian measures of model complexity and fit," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(4), pages 583-639, October.
    11. Cathy W. S. Chen & Mike K. P. So & Ming-Tien Chen, 2005. "A Bayesian threshold nonlinearity test for financial time series," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 24(1), pages 61-75.
    12. Chib S. & Jeliazkov I., 2001. "Marginal Likelihood From the Metropolis-Hastings Output," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 270-281, March.
    13. Wayne DeSarbo & William Cron, 1988. "A maximum likelihood methodology for clusterwise linear regression," Journal of Classification, Springer;The Classification Society, vol. 5(2), pages 249-282, September.
    14. Michel Wedel & Wayne DeSarbo, 1995. "A mixture likelihood approach for generalized linear models," Journal of Classification, Springer;The Classification Society, vol. 12(1), pages 21-55, March.
    15. Cheon, Sooyoung & Kim, Jaehee, 2010. "Multiple change-point detection of multivariate mean vectors with the Bayesian approach," Computational Statistics & Data Analysis, Elsevier, vol. 54(2), pages 406-415, February.
    16. Lee, Chung-Bow, 1998. "Bayesian analysis of a change-point in exponential families with applications," Computational Statistics & Data Analysis, Elsevier, vol. 27(2), pages 195-208, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Shiow-Lan Gau & Jean Dieu Tapsoba & Shen-Ming Lee, 2014. "Bayesian approach for mixture models with grouped data," Computational Statistics, Springer, vol. 29(5), pages 1025-1043, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nima Nonejad, 2013. "Long Memory and Structural Breaks in Realized Volatility: An Irreversible Markov Switching Approach," CREATES Research Papers 2013-26, Department of Economics and Business Economics, Aarhus University.
    2. DESCHAMPS, Philippe J., 2016. "Bayesian Semiparametric Forecasts of Real Interest Rate Data," LIDAM Discussion Papers CORE 2016050, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    3. Koop, Gary & Potter, Simon, 2010. "A flexible approach to parametric inference in nonlinear and time varying time series models," Journal of Econometrics, Elsevier, vol. 159(1), pages 134-150, November.
    4. repec:hal:journl:peer-00732535 is not listed on IDEAS
    5. Raggi, Davide & Bordignon, Silvano, 2012. "Long memory and nonlinearities in realized volatility: A Markov switching approach," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3730-3742.
    6. Nima Nonejad, 2013. "Time-Consistency Problem and the Behavior of US Inflation from 1970 to 2008," CREATES Research Papers 2013-25, Department of Economics and Business Economics, Aarhus University.
    7. Deschamps, Philippe J., 2012. "Bayesian estimation of generalized hyperbolic skewed student GARCH models," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3035-3054.
    8. Bauwens, Luc & Rombouts, Jeroen V.K., 2012. "On marginal likelihood computation in change-point models," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3415-3429.
    9. Salvatore Ingrassia & Simona Minotti & Giorgio Vittadini, 2012. "Local Statistical Modeling via a Cluster-Weighted Approach with Elliptical Distributions," Journal of Classification, Springer;The Classification Society, vol. 29(3), pages 363-401, October.
    10. Xiong, Yingge & Tobias, Justin L. & Mannering, Fred L., 2014. "The analysis of vehicle crash injury-severity data: A Markov switching approach with road-segment heterogeneity," Transportation Research Part B: Methodological, Elsevier, vol. 67(C), pages 109-128.
    11. Gary Koop & Simon M. Potter, 2007. "A flexible approach to parametric inference in nonlinear time series models," Staff Reports 285, Federal Reserve Bank of New York.
    12. Philippe J. Deschamps, 2008. "Comparing smooth transition and Markov switching autoregressive models of US unemployment," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 23(4), pages 435-462.
    13. Kaufmann, Sylvia, 2015. "K-state switching models with time-varying transition distributions—Does loan growth signal stronger effects of variables on inflation?," Journal of Econometrics, Elsevier, vol. 187(1), pages 82-94.
    14. Bauwens, Luc & Dufays, Arnaud & Rombouts, Jeroen V.K., 2014. "Marginal likelihood for Markov-switching and change-point GARCH models," Journal of Econometrics, Elsevier, vol. 178(P3), pages 508-522.
    15. Philippe J. Deschamps, 2008. "Comparing smooth transition and Markov switching autoregressive models of US unemployment," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 23(4), pages 435-462.
    16. Bauwens, Luc & De Backer, Bruno & Dufays, Arnaud, 2014. "A Bayesian method of change-point estimation with recurrent regimes: Application to GARCH models," Journal of Empirical Finance, Elsevier, vol. 29(C), pages 207-229.
    17. Salvatore Ingrassia & Antonio Punzo, 2020. "Cluster Validation for Mixtures of Regressions via the Total Sum of Squares Decomposition," Journal of Classification, Springer;The Classification Society, vol. 37(2), pages 526-547, July.
    18. Wang, Kai Y.K. & Chen, Cathy W.S. & So, Mike K.P., 2023. "Quantile three-factor model with heteroskedasticity, skewness, and leptokurtosis," Computational Statistics & Data Analysis, Elsevier, vol. 182(C).
    19. Fisher, Mark & Jensen, Mark J., 2019. "Bayesian inference and prediction of a multiple-change-point panel model with nonparametric priors," Journal of Econometrics, Elsevier, vol. 210(1), pages 187-202.
    20. M. Hashem Pesaran & Davide Pettenuzzo & Allan Timmermann, 2006. "Forecasting Time Series Subject to Multiple Structural Breaks," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 73(4), pages 1057-1084.
    21. Sylvia Kaufmann, 2016. "Hidden Markov models in time series, with applications in economics," Working Papers 16.06, Swiss National Bank, Study Center Gerzensee.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:55:y:2011:i:7:p:2276-2287. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.