IDEAS home Printed from https://ideas.repec.org/a/spr/soinre/v174y2024i3d10.1007_s11205-024-03416-6.html
   My bibliography  Save this article

Machine Learning-Facilitated Policy Intensity Analysis: A Proposed Procedure and Its Application

Author

Listed:
  • Su Xie

    (Huazhong Agricultural University
    Digital Agriculture Research Institute, Huazhong Agricultural University)

  • Hang Xiong

    (Huazhong Agricultural University
    Digital Agriculture Research Institute, Huazhong Agricultural University)

  • Linmei Shang

    (University of Bonn)

  • Yong Bao

    (Purdue University)

Abstract

Policy intensity is a crucial determinant of policy effectiveness. Analysis of policy intensity can serve as a basis for policy impact evaluation and enable policymakers to make necessary adjustments. Previous studies relied on manual scoring and mainly addressed specialized policies with limited numbers of texts. However, when dealing with text-rich policies, the method inevitably introduced bias and was time-consuming. In this paper, we propose a procedure facilitated by machine learning to analyze the intensity of not only specified but also comprehensive policies with large amounts of texts. Our machine learning-based approach assigns scores to the policy measure dimension, then cross-multiplies with two other dimensions, policy title and document type, to calculate intensity. The efficacy of our approach was demonstrated through a case study of China’s environmental policies for livestock and poultry husbandry, which showed improved performance over traditional methods in terms of efficiency and objectivity.

Suggested Citation

  • Su Xie & Hang Xiong & Linmei Shang & Yong Bao, 2024. "Machine Learning-Facilitated Policy Intensity Analysis: A Proposed Procedure and Its Application," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 174(3), pages 881-904, September.
    • Handle: RePEc:spr:soinre:v:174:y:2024:i:3:d:10.1007_s11205-024-03416-6
    DOI: 10.1007/s11205-024-03416-6
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11205-024-03416-6
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11205-024-03416-6?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ruyin Long & Wenhua Cui & Qianwen Li, 2017. "The Evolution and Effect Evaluation of Photovoltaic Industry Policy in China," Sustainability, MDPI, vol. 9(12), pages 1-40, November.
    2. Kong, Yuan & Feng, Chao & Yang, Jun, 2020. "How does China manage its energy market? A perspective of policy evolution," Energy Policy, Elsevier, vol. 147(C).
    3. Junseop Shim & Chisung Park & Mark Wilding, 2015. "Identifying policy frames through semantic network analysis: an examination of nuclear energy policy across six countries," Policy Sciences, Springer;Society of Policy Sciences, vol. 48(1), pages 51-83, March.
    4. Shuzhong Ma & Jiwen Guo & Hongsheng Zhang, 2019. "Policy Analysis and Development Evaluation of Digital Trade: An International Comparison," China & World Economy, Institute of World Economics and Politics, Chinese Academy of Social Sciences, vol. 27(3), pages 49-75, May.
    5. Youzhu Li & Rui He & Jinsi Liu & Chongguang Li & Jason Xiong, 2021. "Quantitative Evaluation of China’s Pork Industry Policy: A PMC Index Model Approach," Agriculture, MDPI, vol. 11(2), pages 1-21, January.
    6. Libecap, Gary D., 1978. "Economic Variables and the Development of the Law: The Case of Western Mineral Rights," The Journal of Economic History, Cambridge University Press, vol. 38(2), pages 338-362, June.
    7. Begoña Elizalde-San Miguel & Vicente Díaz Gandasegui & Maria T. Sanz García, 2019. "Family Policy Index: A Tool for Policy Makers to Increase the Effectiveness of Family Policies," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 142(1), pages 387-409, February.
    8. Zhang, Guoxing & Deng, Nana & Mou, Haizhen & Zhang, Zhe George & Chen, Xiaofeng, 2019. "The impact of the policy and behavior of public participation on environmental governance performance: Empirical analysis based on provincial panel data in China," Energy Policy, Elsevier, vol. 129(C), pages 1347-1354.
    9. Friedman, Jerome H. & Hastie, Trevor & Tibshirani, Rob, 2010. "Regularization Paths for Generalized Linear Models via Coordinate Descent," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 33(i01).
    10. Jorge Garcés Ferrer & Francisco Ródenas Rigla & Carla Vidal Figueroa, 2016. "Application of Social Policy Index (SPI) Amended in Three OECD Countries: Finland, Spain and Mexico," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 127(2), pages 529-539, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Youzhu Li & Rui He & Jinsi Liu & Chongguang Li & Jason Xiong, 2021. "Quantitative Evaluation of China’s Pork Industry Policy: A PMC Index Model Approach," Agriculture, MDPI, vol. 11(2), pages 1-21, January.
    2. Qiaoqiao Zhan & Katsunori Furuya & Xiaolan Tang & Zhehui Li, 2024. "Policy Development in China’s Protected Scenic and Historic Areas," Land, MDPI, vol. 13(2), pages 1-24, February.
    3. Yingkai Yin & Hongxin Ma & Zhenni Wu & Aobo Yue, 2023. "How Does China Build Its Fintech Strategy? A Perspective of Policy Evolution," Sustainability, MDPI, vol. 15(13), pages 1-21, June.
    4. Ba, Zhichao & Ma, Yaxue & Cai, Jinyao & Li, Gang, 2023. "A citation-based research framework for exploring policy diffusion: Evidence from China's new energy policies," Technological Forecasting and Social Change, Elsevier, vol. 188(C).
    5. Tutz, Gerhard & Pößnecker, Wolfgang & Uhlmann, Lorenz, 2015. "Variable selection in general multinomial logit models," Computational Statistics & Data Analysis, Elsevier, vol. 82(C), pages 207-222.
    6. Rui Wang & Naihua Xiu & Kim-Chuan Toh, 2021. "Subspace quadratic regularization method for group sparse multinomial logistic regression," Computational Optimization and Applications, Springer, vol. 79(3), pages 531-559, July.
    7. Mkhadri, Abdallah & Ouhourane, Mohamed, 2013. "An extended variable inclusion and shrinkage algorithm for correlated variables," Computational Statistics & Data Analysis, Elsevier, vol. 57(1), pages 631-644.
    8. Chen, Le-Yu & Lee, Sokbae, 2018. "Best subset binary prediction," Journal of Econometrics, Elsevier, vol. 206(1), pages 39-56.
    9. Chuliá, Helena & Garrón, Ignacio & Uribe, Jorge M., 2024. "Daily growth at risk: Financial or real drivers? The answer is not always the same," International Journal of Forecasting, Elsevier, vol. 40(2), pages 762-776.
    10. Sung Jae Jun & Sokbae Lee, 2024. "Causal Inference Under Outcome-Based Sampling with Monotonicity Assumptions," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 42(3), pages 998-1009, July.
    11. Xiangwei Li & Thomas Delerue & Ben Schöttker & Bernd Holleczek & Eva Grill & Annette Peters & Melanie Waldenberger & Barbara Thorand & Hermann Brenner, 2022. "Derivation and validation of an epigenetic frailty risk score in population-based cohorts of older adults," Nature Communications, Nature, vol. 13(1), pages 1-11, December.
    12. Christopher J Greenwood & George J Youssef & Primrose Letcher & Jacqui A Macdonald & Lauryn J Hagg & Ann Sanson & Jenn Mcintosh & Delyse M Hutchinson & John W Toumbourou & Matthew Fuller-Tyszkiewicz &, 2020. "A comparison of penalised regression methods for informing the selection of predictive markers," PLOS ONE, Public Library of Science, vol. 15(11), pages 1-14, November.
    13. Heng Chen & Daniel F. Heitjan, 2022. "Analysis of local sensitivity to nonignorability with missing outcomes and predictors," Biometrics, The International Biometric Society, vol. 78(4), pages 1342-1352, December.
    14. Shaobin, Guo & Ahmad, Khalil & Khan, Naqib Ullah, 2024. "Natural resources, geopolitical conflicts, and digital trade: Evidence from China," Resources Policy, Elsevier, vol. 90(C).
    15. S Ariane Christie & Amanda S Conroy & Rachael A Callcut & Alan E Hubbard & Mitchell J Cohen, 2019. "Dynamic multi-outcome prediction after injury: Applying adaptive machine learning for precision medicine in trauma," PLOS ONE, Public Library of Science, vol. 14(4), pages 1-13, April.
    16. Zhu Wang, 2022. "MM for penalized estimation," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 31(1), pages 54-75, March.
    17. Ida Kubiszewski & Kenneth Mulder & Diane Jarvis & Robert Costanza, 2022. "Toward better measurement of sustainable development and wellbeing: A small number of SDG indicators reliably predict life satisfaction," Sustainable Development, John Wiley & Sons, Ltd., vol. 30(1), pages 139-148, February.
    18. Gustavo A. Alonso-Silverio & Víctor Francisco-García & Iris P. Guzmán-Guzmán & Elías Ventura-Molina & Antonio Alarcón-Paredes, 2021. "Toward Non-Invasive Estimation of Blood Glucose Concentration: A Comparative Performance," Mathematics, MDPI, vol. 9(20), pages 1-13, October.
    19. Christopher Kath & Florian Ziel, 2018. "The value of forecasts: Quantifying the economic gains of accurate quarter-hourly electricity price forecasts," Papers 1811.08604, arXiv.org.
    20. Wang, Jianlong & Wu, Haitao & Liu, Yong & Wang, Weilong, 2024. "Health welfare in the digital era: Exploring the impact of digital trade on residents' health," Economics & Human Biology, Elsevier, vol. 54(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:soinre:v:174:y:2024:i:3:d:10.1007_s11205-024-03416-6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.