IDEAS home Printed from https://ideas.repec.org/a/wsi/ijmpcx/v26y2015i04ns0129183115500412.html
   My bibliography  Save this article

Web document ranking via active learning and kernel principal component analysis

Author

Listed:
  • Fei Cai

    (Science and Technology on Information Systems Engineering Laboratory, National University of Defense Technology, Changsha 410073, P. R. China)

  • Honghui Chen

    (Science and Technology on Information Systems Engineering Laboratory, National University of Defense Technology, Changsha 410073, P. R. China)

  • Zhen Shu

    (Science and Technology on Information Systems Engineering Laboratory, National University of Defense Technology, Changsha 410073, P. R. China)

Abstract

Web document ranking arises in many information retrieval (IR) applications, such as the search engine, recommendation system and online advertising. A challenging issue is how to select the representative query-document pairs and informative features as well for better learning and exploring new ranking models to produce an acceptable ranking list of candidate documents of each query. In this study, we propose an active sampling (AS) plus kernel principal component analysis (KPCA) based ranking model, viz. AS-KPCA Regression, to study the document ranking for a retrieval system, i.e. how to choose the representative query-document pairs and features for learning. More precisely, we fill those documents gradually into the training set by AS such that each of which will incur the highest expected DCG loss if unselected. Then, the KPCA is performed via projecting the selected query-document pairs ontop-principal components in the feature space to complete the regression. Hence, we can cut down the computational overhead and depress the impact incurred by noise simultaneously. To the best of our knowledge, we are the first to perform the document ranking via dimension reductions in two dimensions, namely, the number of documents and features simultaneously. Our experiments demonstrate that the performance of our approach is better than that of the baseline methods on the public LETOR 4.0 datasets. Our approach brings an improvement against RankBoost as well as other baselines near 20% in terms of MAP metric and less improvements using P@Kand NDCG@K, respectively. Moreover, our approach is particularly suitable for document ranking on the noisy dataset in practice.

Suggested Citation

  • Fei Cai & Honghui Chen & Zhen Shu, 2015. "Web document ranking via active learning and kernel principal component analysis," International Journal of Modern Physics C (IJMPC), World Scientific Publishing Co. Pte. Ltd., vol. 26(04), pages 1-18.
  • Handle: RePEc:wsi:ijmpcx:v:26:y:2015:i:04:n:s0129183115500412
    DOI: 10.1142/S0129183115500412
    as

    Download full text from publisher

    File URL: http://www.worldscientific.com/doi/abs/10.1142/S0129183115500412
    Download Restriction: Access to full text is restricted to subscribers

    File URL: https://libkey.io/10.1142/S0129183115500412?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Trevor Cox, 2001. "Multidimensional scaling used in multivariate statistical process control," Journal of Applied Statistics, Taylor & Francis Journals, vol. 28(3-4), pages 365-378.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. repec:zbw:bofitp:2011_018 is not listed on IDEAS
    2. Antonis A. Michis, 2021. "Wavelet Multidimensional Scaling Analysis of European Economic Sentiment Indicators," Journal of Classification, Springer;The Classification Society, vol. 38(3), pages 443-480, October.
    3. repec:hum:wpaper:sfb649dp2006-040 is not listed on IDEAS
    4. Wayne DeSarbo & Joonwook Park & Crystal Scott, 2008. "A Model-Based Approach for Visualizing the Dimensional Structure of Ordered Successive Categories Preference Data," Psychometrika, Springer;The Psychometric Society, vol. 73(1), pages 1-20, March.
    5. Roberta Siciliano & Antonia D’Ambrosio & Massimo Aria & Sonia Amodio, 2016. "Analysis of Web Visit Histories, Part I: Distance-Based Visualization of Sequence Rules," Journal of Classification, Springer;The Classification Society, vol. 33(2), pages 298-324, July.
    6. Blanchard, Gilles & Kawanabe, Motoaki & Sugiyama, Masashi & Spokoiny, Vladimir & Müller, Klaus-Robert, 2006. "In search of non-Gaussian components of a high-dimensional distribution," SFB 649 Discussion Papers 2006-040, Humboldt University Berlin, Collaborative Research Center 649: Economic Risk.
    7. Sarlin, Peter & Peltonen, Tuomas A., 2013. "Mapping the state of financial stability," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 26(C), pages 46-76.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wsi:ijmpcx:v:26:y:2015:i:04:n:s0129183115500412. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Tai Tone Lim (email available below). General contact details of provider: http://www.worldscinet.com/ijmpc/ijmpc.shtml .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.