IDEAS home Printed from https://ideas.repec.org/a/vrs/cejopp/v9y2015i2p54-62n3.html
   My bibliography  Save this article

Measuring the Use of Knowledge in Policy Development

Author

Listed:
  • Witting Antje

    (Dep. Politics and Public Administration at the University of Konstanz)

Abstract

Public hearings are frequently used on all levels of government to systematically collect and analyze information in the early stages of legislative policymaking. The methods currently employed measure knowledge utilization in this context by means of citation analysis of edited articles and/or reports that summarize the information shared at these meetings. By combining citation analysis and social network analysis, this article develops a methodology that can be used to capture citations in transcripts of public hearings that precede these reports. In order to demonstrate its strengths and weaknesses, the method is utilized to analyze the 2009 hearings that informed the 2010 House of Commons Transport Committee report on developing the capacity of major roads in the United Kingdom to meet the country’s strategic transport needs. The research shows a good degree of consistency between two independent coders who employed this method to distinguish citations from non-citations and classify the data. It is concluded that the method can be utilized to reliably measure knowledge utilization at public hearings, and that it can be employed in conjunction with research that focuses on measuring citations in memos, briefings, articles or reports integrating some of the evidence given at these meetings.

Suggested Citation

  • Witting Antje, 2015. "Measuring the Use of Knowledge in Policy Development," Central European Journal of Public Policy, Sciendo, vol. 9(2), pages 54-62, December.
    • Handle: RePEc:vrs:cejopp:v:9:y:2015:i:2:p:54-62:n:3
    DOI: 10.1515/cejpp-2016-0012
    as

    Download full text from publisher

    File URL: https://doi.org/10.1515/cejpp-2016-0012
    Download Restriction: no
    File URL: https://libkey.io/10.1515/cejpp-2016-0012?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Andrew Rich, 2001. "The Politics of Expertise in Congress and the News Media," Social Science Quarterly, Southwestern Social Science Association, vol. 82(3), pages 583-601, September.
    2. Guo Zhang & Ying Ding & Staša Milojević, 2013. "Citation content analysis (CCA): A framework for syntactic and semantic analysis of citation content," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 64(7), pages 1490-1503, July.
    3. Nancy Shulock, 1999. "The paradox of policy analysis: If it is not used, why do we produce so much of it?," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 18(2), pages 226-244.
    4. Guo Zhang & Ying Ding & Staša Milojević, 2013. "Citation content analysis (CCA): A framework for syntactic and semantic analysis of citation content," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 64(7), pages 1490-1503, July.
    5. Loet Leydesdorff, 2007. "Betweenness centrality as an indicator of the interdisciplinarity of scientific journals," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 58(9), pages 1303-1319, July.
    6. Erjia Yan & Ying Ding, 2009. "Applying centrality measures to impact analysis: A coauthorship network analysis," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 60(10), pages 2107-2118, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lutz Bornmann & Robin Haunschild & Sven E. Hug, 2018. "Visualizing the context of citations referencing papers published by Eugene Garfield: a new type of keyword co-occurrence analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(2), pages 427-437, February.
    2. Liu, Xiaojuan & Wang, Chenlin & Chen, Dar-Zen & Huang, Mu-Hsuan, 2022. "Exploring perception of retraction based on mentioned status in post-retraction citations," Journal of Informetrics, Elsevier, vol. 16(3).
    3. Konstantin Fursov & Alina Kadyrova, 2017. "How the analysis of transitionary references in knowledge networks and their centrality characteristics helps in understanding the genesis of growing technology areas," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(3), pages 1947-1963, June.
    4. Adilson Vital & Diego R. Amancio, 2022. "A comparative analysis of local similarity metrics and machine learning approaches: application to link prediction in author citation networks," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(10), pages 6011-6028, October.
    5. Hamid R. Jamali & Majid Nabavi & Saeid Asadi, 2018. "How video articles are cited, the case of JoVE: Journal of Visualized Experiments," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(3), pages 1821-1839, December.
    6. Tehmina Amjad & Ying Ding & Ali Daud & Jian Xu & Vincent Malic, 2015. "Topic-based heterogeneous rank," Scientometrics, Springer;Akadémiai Kiadó, vol. 104(1), pages 313-334, July.
    7. Saikou Y. Diallo & Christopher J. Lynch & Ross Gore & Jose J. Padilla, 2016. "Identifying key papers within a journal via network centrality measures," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(3), pages 1005-1020, June.
    8. Tahamtan, Iman & Bornmann, Lutz, 2018. "Core elements in the process of citing publications: Conceptual overview of the literature," Journal of Informetrics, Elsevier, vol. 12(1), pages 203-216.
    9. Jingwei Zheng & Ke Zhang & Boya Han & Jiayi Hou, 2023. "Research Interdisciplinarity and Citation Impact: A Network Analysis of Social Networking Sites Research," SAGE Open, , vol. 13(3), pages 21582440231, August.
    10. Yang, Jinqing & Liu, Zhifeng, 2022. "The effect of citation behaviour on knowledge diffusion and intellectual structure," Journal of Informetrics, Elsevier, vol. 16(1).
    11. Błoński Krzysztof, 2023. "Analysis of Citations and Co-Citations of the Term ‘Word of Mouth’ Based on Publications in the Field of Social Sciences," Marketing of Scientific and Research Organizations, Sciendo, vol. 48(2), pages 111-133, June.
    12. Benatti, Alexandre & Ferraz de Arrruda, Henrique & Nascimento Silva, Filipi & da Fontoura Costa, Luciano, 2021. "Enriching and analyzing small citation networks: A case study on transistor’s history," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 573(C).
    13. Kai Nishikawa, 2023. "How and why are citations between disciplines made? A citation context analysis focusing on natural sciences and social sciences and humanities," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(5), pages 2975-2997, May.
    14. Wang, Shiyun & Mao, Jin & Lu, Kun & Cao, Yujie & Li, Gang, 2021. "Understanding interdisciplinary knowledge integration through citance analysis: A case study on eHealth," Journal of Informetrics, Elsevier, vol. 15(4).
    15. Ruhao Zhang & Junpeng Yuan, 2022. "Enhanced author bibliographic coupling analysis using semantic and syntactic citation information," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(12), pages 7681-7706, December.
    16. Ali Daud & Min Song & Malik Khizar Hayat & Tehmina Amjad & Rabeeh Ayaz Abbasi & Hassan Dawood & Anwar Ghani, 2020. "Finding rising stars in bibliometric networks," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(1), pages 633-661, July.
    17. Frederique Bordignon, 2022. "Critical citations in knowledge construction and citation analysis: from paradox to definition," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(2), pages 959-972, February.
    18. Chen, Lixin, 2017. "Do patent citations indicate knowledge linkage? The evidence from text similarities between patents and their citations," Journal of Informetrics, Elsevier, vol. 11(1), pages 63-79.
    19. Marta Kuc-Czarnecka & Magdalena Olczyk, 2020. "How ethics combine with big data: a bibliometric analysis," Palgrave Communications, Palgrave Macmillan, vol. 7(1), pages 1-9, December.
    20. Henrique F. Arruda & Cesar H. Comin & Luciano da F. Costa, 2018. "How integrated are theoretical and applied physics?," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(2), pages 1113-1121, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:vrs:cejopp:v:9:y:2015:i:2:p:54-62:n:3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Peter Golla (email available below). General contact details of provider: https://www.sciendo.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.