IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v81y2009i1d10.1007_s11192-009-1885-x.html
   My bibliography  Save this article

A comparison of methods for detecting hot topics

Author

Listed:
  • Yuen-Hsien Tseng

    (National Taiwan Normal University)

  • Yu-I Lin

    (Taipei Municipal University of Education)

  • Yi-Yang Lee

    (Taiwan Institute of Economic Research)

  • Wen-Chi Hung

    (National Applied Research Laboratories)

  • Chun-Hsiang Lee

    (National Applied Research Laboratories)

Abstract

In scientometrics for trend analysis, parameter choices for observing trends are often made ad hoc in past studies. For examples, different year spans might be used to create the time sequence and different indices were chosen for trend observation. However, the effectiveness of these choices was hardly known, quantitatively and comparatively. This work provides clues to better interpret the results when a certain choice was made. Specifically, by sorting research topics in decreasing order of interest predicted by a trend index and then by evaluating this ordering based on information retrieval measures, we compare a number of trend indices (percentage of increase vs. regression slope), trend formulations (simple trend vs. eigen-trend), and options (various year spans and durations for prediction) in different domains (safety agriculture and information retrieval) with different collection scales (72500 papers vs. 853 papers) to know which one leads to better trend observation. Our results show that the slope of linear regression on the time series performs constantly better than the others. More interestingly, this index is robust under different conditions and is hardly affected even when the collection was split into arbitrary (e.g., only two) periods. Implications of these results are discussed. Our work does not only provide a method to evaluate trend prediction performance for scientometrics, but also provides insights and reflections for past and future trend observation studies.

Suggested Citation

  • Yuen-Hsien Tseng & Yu-I Lin & Yi-Yang Lee & Wen-Chi Hung & Chun-Hsiang Lee, 2009. "A comparison of methods for detecting hot topics," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(1), pages 73-90, October.
    • Handle: RePEc:spr:scient:v:81:y:2009:i:1:d:10.1007_s11192-009-1885-x
    DOI: 10.1007/s11192-009-1885-x
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-009-1885-x
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-009-1885-x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. E. C. M. Noyons & H. F. Moed & A. F. J. Raan, 1999. "Integrating research performance analysis and science mapping," Scientometrics, Springer;Akadémiai Kiadó, vol. 46(3), pages 591-604, November.
    2. E. C. M. Noyons & A. F. J. van Raan, 1998. "Monitoring scientific developments from a dynamic perspective: Self‐organized structuring to map neural network research," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 49(1), pages 68-81.
    3. Chaomei Chen, 2006. "CiteSpace II: Detecting and visualizing emerging trends and transient patterns in scientific literature," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 57(3), pages 359-377, February.
    4. Yuen‐Hsien Tseng, 2002. "Automatic thesaurus generation for Chinese documents," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 53(13), pages 1130-1138, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. O. Mryglod & Yu. Holovatch & R. Kenna & B. Berche, 2016. "Quantifying the evolution of a scientific topic: reaction of the academic community to the Chornobyl disaster," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(3), pages 1151-1166, March.
    2. Yuen-Hsien Tseng & Chun-Yen Chang & M. Shane Tutwiler & Ming-Chao Lin & James P. Barufaldi, 2013. "A scientometric analysis of the effectiveness of Taiwan’s educational research projects," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(3), pages 1141-1166, June.
    3. Woondong Yeo & Seonho Kim & Byoung-Youl Coh & Jaewoo Kang, 2013. "A quantitative approach to recommend promising technologies for SME innovation: a case study on knowledge arbitrage from LCD to solar cell," Scientometrics, Springer;Akadémiai Kiadó, vol. 96(2), pages 589-604, August.
    4. Ryosuke L. Ohniwa & Aiko Hibino & Kunio Takeyasu, 2010. "Trends in research foci in life science fields over the last 30 years monitored by emerging topics," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(1), pages 111-127, October.
    5. Jinlou Zhao & Hongyu Gao & Yongli Li & Jiaguo Liu, 2017. "Which factors affect the duration of hot topics on social media platforms?," Quality & Quantity: International Journal of Methodology, Springer, vol. 51(5), pages 2395-2407, September.
    6. Yuen-Hsien Tseng & Ming-Yueh Tsay, 2013. "Journal clustering of library and information science for subfield delineation using the bibliometric analysis toolkit: CATAR," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(2), pages 503-528, May.
    7. Antonio Fernández-Cano & Manuel Torralbo & Mónica Vallejo, 2012. "Time series of scientific growth in Spanish doctoral theses (1848–2009)," Scientometrics, Springer;Akadémiai Kiadó, vol. 91(1), pages 15-36, April.
    8. Leonidas Akritidis & Dimitrios Katsaros & Panayiotis Bozanis, 2012. "Identifying attractive research fields for new scientists," Scientometrics, Springer;Akadémiai Kiadó, vol. 91(3), pages 869-894, June.
    9. Srđan Bojović & Rada Matić & Zorica Popović & Miroslava Smiljanić & Milena Stefanović & Vera Vidaković, 2014. "An overview of forestry journals in the period 2006–2010 as basis for ascertaining research trends," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(2), pages 1331-1346, February.
    10. Soroush Taheri & Sadegh Aliakbary, 2022. "Research trend prediction in computer science publications: a deep neural network approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(2), pages 849-869, February.
    11. Chen, Kaihua & Guan, Jiancheng, 2011. "A bibliometric investigation of research performance in emerging nanobiopharmaceuticals," Journal of Informetrics, Elsevier, vol. 5(2), pages 233-247.
    12. Zhichao Fang & Rodrigo Costas & Wencan Tian & Xianwen Wang & Paul Wouters, 2020. "An extensive analysis of the presence of altmetric data for Web of Science publications across subject fields and research topics," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(3), pages 2519-2549, September.
    13. Ma, Jing & Abrams, Natalie F. & Porter, Alan L. & Zhu, Donghua & Farrell, Dorothy, 2019. "Identifying translational indicators and technology opportunities for nanomedical research using tech mining: The case of gold nanostructures," Technological Forecasting and Social Change, Elsevier, vol. 146(C), pages 767-775.
    14. Heeyong Noh & Sungjoo Lee, 2019. "Where technology transfer research originated and where it is going: a quantitative analysis of literature published between 1980 and 2015," The Journal of Technology Transfer, Springer, vol. 44(3), pages 700-740, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mathew Azarian & Hao Yu & Asmamaw Tadege Shiferaw & Tor Kristian Stevik, 2023. "Do We Perform Systematic Literature Review Right? A Scientific Mapping and Methodological Assessment," Logistics, MDPI, vol. 7(4), pages 1-32, November.
    2. Yuen-Hsien Tseng & Ming-Yueh Tsay, 2013. "Journal clustering of library and information science for subfield delineation using the bibliometric analysis toolkit: CATAR," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(2), pages 503-528, May.
    3. Li Yan & Wang Zhiping, 2023. "Mapping the Literature on Academic Publishing: A Bibliometric Analysis on WOS," SAGE Open, , vol. 13(1), pages 21582440231, March.
    4. Loet Leydesdorff, 2013. "Statistics for the dynamic analysis of scientometric data: the evolution of the sciences in terms of trajectories and regimes," Scientometrics, Springer;Akadémiai Kiadó, vol. 96(3), pages 731-741, September.
    5. Seyedmohammadreza Hosseini & Hamed Baziyad & Rasoul Norouzi & Sheida Jabbedari Khiabani & Győző Gidófalvi & Amir Albadvi & Abbas Alimohammadi & Seyedehsan Seyedabrishami, 2021. "Mapping the intellectual structure of GIS-T field (2008–2019): a dynamic co-word analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(4), pages 2667-2688, April.
    6. Ryosuke L. Ohniwa & Aiko Hibino & Kunio Takeyasu, 2010. "Trends in research foci in life science fields over the last 30 years monitored by emerging topics," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(1), pages 111-127, October.
    7. Tingcan Ma & Ruinan Li & Guiyan Ou & Mingliang Yue, 2018. "Topic based research competitiveness evaluation," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(2), pages 789-803, November.
    8. Jacob Wood & Gohar Feroz Khan, 2015. "International trade negotiation analysis: network and semantic knowledge infrastructure," Scientometrics, Springer;Akadémiai Kiadó, vol. 105(1), pages 537-556, October.
    9. Daniel Fonseca Costa & Francisval Carvalho & Bruno César Moreira & José Willer Prado, 2017. "Bibliometric analysis on the association between behavioral finance and decision making with cognitive biases such as overconfidence, anchoring effect and confirmation bias," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(3), pages 1775-1799, June.
    10. Xingwen Chen & Li Zhu & Chao Liu & Chunhua Chen & Jun Liu & Dongxia Huo, 2023. "Workplace Diversity in the Asia-Pacific Region: A Review of Literature and Directions for Future Research," Asia Pacific Journal of Management, Springer, vol. 40(3), pages 1021-1045, September.
    11. Ziwen Wei & Man Yuan, 2023. "Research on the Current Situation and Future Development Trend of Immersive Virtual Reality in the Field of Education," Sustainability, MDPI, vol. 15(9), pages 1-18, May.
    12. Hrosul, Viktoriia & Kruhlova, Olena & Kolesnyk, Alina, 2023. "Digitalization of the agricultural sector: the impact of ICT on the development of enterprises in Ukraine," Agricultural and Resource Economics: International Scientific E-Journal, Agricultural and Resource Economics: International Scientific E-Journal, vol. 9(4), December.
    13. Yucheng Zhang & Zhiling Wang & Lin Xiao & Lijun Wang & Pei Huang, 2023. "Discovering the evolution of online reviews: A bibliometric review," Electronic Markets, Springer;IIM University of St. Gallen, vol. 33(1), pages 1-22, December.
    14. Gaviria-Marin, Magaly & Merigó, José M. & Baier-Fuentes, Hugo, 2019. "Knowledge management: A global examination based on bibliometric analysis," Technological Forecasting and Social Change, Elsevier, vol. 140(C), pages 194-220.
    15. Petersen, Alexander M. & Rotolo, Daniele & Leydesdorff, Loet, 2016. "A triple helix model of medical innovation: Supply, demand, and technological capabilities in terms of Medical Subject Headings," Research Policy, Elsevier, vol. 45(3), pages 666-681.
    16. Tong Chen & Mo Wang & Jin Su & Jianjun Li, 2023. "Unlocking the Positive Impact of Bio-Swales on Hydrology, Water Quality, and Biodiversity: A Bibliometric Review," Sustainability, MDPI, vol. 15(10), pages 1-19, May.
    17. Gao, Qiang & Liang, Zhentao & Wang, Ping & Hou, Jingrui & Chen, Xiuxiu & Liu, Manman, 2021. "Potential index: Revealing the future impact of research topics based on current knowledge networks," Journal of Informetrics, Elsevier, vol. 15(3).
    18. Hailiang Li & M. James C. Crabbe & Haikui Chen, 2020. "History and Trends in Ecological Stoichiometry Research from 1992 to 2019: A Scientometric Analysis," Sustainability, MDPI, vol. 12(21), pages 1-21, October.
    19. Nina Sakinah Ahmad Rofaie & Seuk Wai Phoong & Muzalwana Abdul Talib & Ainin Sulaiman, 2023. "Light-emitting diode (LED) research: A bibliometric analysis during 2003–2018," Quality & Quantity: International Journal of Methodology, Springer, vol. 57(1), pages 173-191, February.
    20. Serhat Burmaoglu & Ozcan Saritas, 2019. "An evolutionary analysis of the innovation policy domain: Is there a paradigm shift?," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(3), pages 823-847, March.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:81:y:2009:i:1:d:10.1007_s11192-009-1885-x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.