IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v53y2009i7p2617-2627.html
   My bibliography  Save this article

Bayesian estimation and variable selection for single index models

Author

Listed:
  • Wang, Hai-Bin

Abstract

We develop a fully Bayesian method to analyze the single index models, including variable selection, the index vector estimation and the link function fitting with free-knot splines. The proposed method is implemented by means of the reversible jump Markov chain Monte Carlo technique. We treat the marginal posterior of all the unknown quantities except the spline coefficients and error variance as the target distribution to reduce the dimension of the parameters and to obtain a rapid algorithm. We design a new random walk Metropolis sampler to sample from the conditional posterior distribution of the index vector. The proposed method is verified by simulation studies, and is applied to analyze two real data sets.

Suggested Citation

  • Wang, Hai-Bin, 2009. "Bayesian estimation and variable selection for single index models," Computational Statistics & Data Analysis, Elsevier, vol. 53(7), pages 2617-2627, May.
    • Handle: RePEc:eee:csdana:v:53:y:2009:i:7:p:2617-2627
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167-9473(08)00580-X
    Download Restriction: Full text for ScienceDirect subscribers only.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Yu Y. & Ruppert D., 2002. "Penalized Spline Estimation for Partially Linear Single-Index Models," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 1042-1054, December.
    2. Lindstrom, Mary J., 2002. "Bayesian estimation of free-knot splines using reversible jumps," Computational Statistics & Data Analysis, Elsevier, vol. 41(2), pages 255-269, December.
    3. Stoker, Thomas M, 1986. "Consistent Estimation of Scaled Coefficients," Econometrica, Econometric Society, vol. 54(6), pages 1461-1481, November.
    4. C. C. Holmes & B. K. Mallick, 2001. "Bayesian regression with multivariate linear splines," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 63(1), pages 3-17.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Wai-Yin Poon & Hai-Bin Wang, 2014. "Multivariate partially linear single-index models: Bayesian analysis," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 26(4), pages 755-768, December.
    2. Jianbo Li & Yuan Li & Riquan Zhang, 2017. "B spline variable selection for the single index models," Statistical Papers, Springer, vol. 58(3), pages 691-706, September.
    3. Yazhao Lv & Riquan Zhang & Weihua Zhao & Jicai Liu, 2014. "Quantile regression and variable selection for the single-index model," Journal of Applied Statistics, Taylor & Francis Journals, vol. 41(7), pages 1565-1577, July.
    4. Hyung G. Park & Danni Wu & Eva Petkova & Thaddeus Tarpey & R. Todd Ogden, 2023. "Bayesian Index Models for Heterogeneous Treatment Effects on a Binary Outcome," Statistics in Biosciences, Springer;International Chinese Statistical Association, vol. 15(2), pages 397-418, July.
    5. Yunquan Song & Hang Su & Minmin Zhan, 2024. "Local Walsh-average-based Estimation and Variable Selection for Spatial Single-index Autoregressive Models," Networks and Spatial Economics, Springer, vol. 24(2), pages 313-339, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wai-Yin Poon & Hai-Bin Wang, 2014. "Multivariate partially linear single-index models: Bayesian analysis," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 26(4), pages 755-768, December.
    2. Qingming Zou & Zhongyi Zhu, 2014. "M-estimators for single-index model using B-spline," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 77(2), pages 225-246, February.
    3. Wu, Jingwei & Peng, Hanxiang & Tu, Wanzhu, 2019. "Large-sample estimation and inference in multivariate single-index models," Journal of Multivariate Analysis, Elsevier, vol. 171(C), pages 382-396.
    4. Chin-Shang Li & Minggen Lu, 2018. "A lack-of-fit test for generalized linear models via single-index techniques," Computational Statistics, Springer, vol. 33(2), pages 731-756, June.
    5. Zhiyong Chen & Jianbao Chen, 2022. "Bayesian analysis of partially linear, single-index, spatial autoregressive models," Computational Statistics, Springer, vol. 37(1), pages 327-353, March.
    6. Huang, Zhensheng & Lin, Bingqing & Feng, Fan & Pang, Zhen, 2013. "Efficient penalized estimating method in the partially varying-coefficient single-index model," Journal of Multivariate Analysis, Elsevier, vol. 114(C), pages 189-200.
    7. Shang, Shulian & Liu, Mengling & Zeleniuch-Jacquotte, Anne & Clendenen, Tess V. & Krogh, Vittorio & Hallmans, Goran & Lu, Wenbin, 2013. "Partially linear single index Cox regression model in nested case-control studies," Computational Statistics & Data Analysis, Elsevier, vol. 67(C), pages 199-212.
    8. Lin, Wei & Kulasekera, K.B., 2010. "Testing the equality of linear single-index models," Journal of Multivariate Analysis, Elsevier, vol. 101(5), pages 1156-1167, May.
    9. Qingming Zou & Zhongyi Zhu & Jinglong Wang, 2009. "Local influence analysis for penalized Gaussian likelihood estimation in partially linear single-index models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 61(4), pages 905-918, December.
    10. Ping Yu & Jiang Du & Zhongzhan Zhang, 2020. "Single-index partially functional linear regression model," Statistical Papers, Springer, vol. 61(3), pages 1107-1123, June.
    11. Song Song, 2011. "Dynamic Large Spatial Covariance Matrix Estimation in Application to Semiparametric Model Construction via Variable Clustering: the SCE approach," Papers 1106.3921, arXiv.org, revised Jun 2011.
    12. Andrés Alonso & Ana Sipols & Silvia Quintas, 2013. "A single-index model procedure for interpolation intervals in time series," Computational Statistics, Springer, vol. 28(4), pages 1463-1484, August.
    13. Jianhong Shi & Qian Yang & Xiongya Li & Weixing Song, 2017. "Effects of measurement error on a class of single-index varying coefficient regression models," Computational Statistics, Springer, vol. 32(3), pages 977-1001, September.
    14. Ichimura, Hidehiko & Thompson, T. Scott, 1998. "Maximum likelihood estimation of a binary choice model with random coefficients of unknown distribution," Journal of Econometrics, Elsevier, vol. 86(2), pages 269-295, June.
    15. Delgado, Miguel A. & Rodriguez-Poo, Juan M. & Wolf, Michael, 2001. "Subsampling inference in cube root asymptotics with an application to Manski's maximum score estimator," Economics Letters, Elsevier, vol. 73(2), pages 241-250, November.
    16. Pierre Dubois & Bruno Jullien & Thierry Magnac, 2008. "Formal and Informal Risk Sharing in LDCs: Theory and Empirical Evidence," Econometrica, Econometric Society, vol. 76(4), pages 679-725, July.
    17. Lahiri, Kajal & Yang, Liu, 2013. "Forecasting Binary Outcomes," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1025-1106, Elsevier.
    18. Lai, Peng & Wang, Qihua & Lian, Heng, 2012. "Bias-corrected GEE estimation and smooth-threshold GEE variable selection for single-index models with clustered data," Journal of Multivariate Analysis, Elsevier, vol. 105(1), pages 422-432.
    19. Halbert White & Karim Chalak, 2013. "Identification and Identification Failure for Treatment Effects Using Structural Systems," Econometric Reviews, Taylor & Francis Journals, vol. 32(3), pages 273-317, November.
    20. repec:wyi:journl:002176 is not listed on IDEAS
    21. Ferraccioli, Federico & Sangalli, Laura M. & Finos, Livio, 2022. "Some first inferential tools for spatial regression with differential regularization," Journal of Multivariate Analysis, Elsevier, vol. 189(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:53:y:2009:i:7:p:2617-2627. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.