IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v16y2023i12p4654-d1169025.html
   My bibliography  Save this article

Named Entity Identification in the Power Dispatch Domain Based on RoBERTa-Attention-FL Model

Author

Listed:
  • Yan Chen

    (School of Computer and Electronic Information, Guangxi University, Nanning 530004, China
    Guangxi Intelligent Digital Services Research Center of Engineering Technology, Nanning 530004, China)

  • Dezhao Lin

    (School of Computer and Electronic Information, Guangxi University, Nanning 530004, China)

  • Qi Meng

    (Guangxi Power Grid Co., Ltd., Nanning 530022, China)

  • Zengfu Liang

    (School of Computer and Electronic Information, Guangxi University, Nanning 530004, China)

  • Zhixiang Tan

    (School of Computer and Electronic Information, Guangxi University, Nanning 530004, China)

Abstract

Named entity identification is an important step in building a knowledge graph of the grid domain, which contains a certain number of nested entities. To address the issue of nested entities in the Chinese power dispatching domain’s named entity recognition, we propose a RoBERTa-Attention-FL model. This model effectively recognizes nested entities using the span representation annotation method. We extract the output values from RoBERTa’s middle 4–10 layers, obtain syntactic information from the Transformer Encoder layers via the multi-head self-attention mechanism, and integrate it with deep semantic information output from RoBERTa’s last layer. During training, we use Focal Loss to mitigate the sample imbalance problem. To evaluate the model’s performance, we construct named entity recognition datasets for flat and nested entities in the power dispatching domain annotated with actual power operation data, and conduct experiments. The results indicate that compared to the baseline model, the RoBERTa-Attention-FL model significantly improves recognition performance, increasing the F1-score by 4.28% to 90.35%, with an accuracy rate of 92.53% and a recall rate of 88.12%.

Suggested Citation

  • Yan Chen & Dezhao Lin & Qi Meng & Zengfu Liang & Zhixiang Tan, 2023. "Named Entity Identification in the Power Dispatch Domain Based on RoBERTa-Attention-FL Model," Energies, MDPI, vol. 16(12), pages 1-13, June.
  • Handle: RePEc:gam:jeners:v:16:y:2023:i:12:p:4654-:d:1169025
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/16/12/4654/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/1996-1073/16/12/4654/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Lanfei He & Xuefei Zhang & Zhiwei Li & Peng Xiao & Ziming Wei & Xu Cheng & Shaocheng Qu & Manman Yuan, 2022. "A Chinese Named Entity Recognition Model of Maintenance Records for Power Primary Equipment Based on Progressive Multitype Feature Fusion," Complexity, Hindawi, vol. 2022, pages 1-11, February.
    2. Dileep, G., 2020. "A survey on smart grid technologies and applications," Renewable Energy, Elsevier, vol. 146(C), pages 2589-2625.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hafize Nurgul Durmus Senyapar & Ramazan Bayindir, 2023. "The Research Agenda on Smart Grids: Foresights for Social Acceptance," Energies, MDPI, vol. 16(18), pages 1-31, September.
    2. Omar Al-Ani & Sanjoy Das, 2022. "Reinforcement Learning: Theory and Applications in HEMS," Energies, MDPI, vol. 15(17), pages 1-37, September.
    3. Badr Eddine Lebrouhi & Eric Schall & Bilal Lamrani & Yassine Chaibi & Tarik Kousksou, 2022. "Energy Transition in France," Sustainability, MDPI, vol. 14(10), pages 1-28, May.
    4. Marques, Vítor & Costa, Paulo Moisés & Bento, Nuno, 2022. "Greater than the sum: On regulating innovation in electricity distribution networks with externalities," Utilities Policy, Elsevier, vol. 79(C).
    5. Sergiu-Mihai Hategan & Nicoleta Stefu & Marius Paulescu, 2023. "An Ensemble Approach for Intra-Hour Forecasting of Solar Resource," Energies, MDPI, vol. 16(18), pages 1-12, September.
    6. Michal Ptacek & Vaclav Vycital & Petr Toman & Jan Vaculik, 2019. "Analysis of Dense-Mesh Distribution Network Operation Using Long-Term Monitoring Data," Energies, MDPI, vol. 12(22), pages 1-25, November.
    7. Icaza-Alvarez, Daniel & Jurado, Francisco & Tostado-Véliz, Marcos & Arevalo, Paúl, 2022. "Decarbonization of the Galapagos Islands. Proposal to transform the energy system into 100% renewable by 2050," Renewable Energy, Elsevier, vol. 189(C), pages 199-220.
    8. Matthew Gough & Sérgio F. Santos & Mohammed Javadi & Rui Castro & João P. S. Catalão, 2020. "Prosumer Flexibility: A Comprehensive State-of-the-Art Review and Scientometric Analysis," Energies, MDPI, vol. 13(11), pages 1-32, May.
    9. Reda El Makroum & Ahmed Khallaayoun & Rachid Lghoul & Kedar Mehta & Wilfried Zörner, 2023. "Home Energy Management System Based on Genetic Algorithm for Load Scheduling: A Case Study Based on Real Life Consumption Data," Energies, MDPI, vol. 16(6), pages 1-18, March.
    10. Antonio E. Saldaña-González & Andreas Sumper & Mònica Aragüés-Peñalba & Miha Smolnikar, 2020. "Advanced Distribution Measurement Technologies and Data Applications for Smart Grids: A Review," Energies, MDPI, vol. 13(14), pages 1-34, July.
    11. Patricia Stefan de Carvalho & Julio Cezar Mairesse Siluk & Jones Lui s Schaefer, 2022. "Analysis of Factors that Interfere with the Regulatory Energy Process with Emphasis on the Energy Cloud," International Journal of Energy Economics and Policy, Econjournals, vol. 12(2), pages 325-335, March.
    12. Chongchong Xu & Zhicheng Liao & Chaojie Li & Xiaojun Zhou & Renyou Xie, 2022. "Review on Interpretable Machine Learning in Smart Grid," Energies, MDPI, vol. 15(12), pages 1-31, June.
    13. Mehmet Efe Biresselioglu & Muhittin Hakan Demir & Sebnem Altinci, 2022. "Understanding the Citizen’s Role in the Transition to a Smart Energy System: Are We Ready?," Sustainability, MDPI, vol. 14(10), pages 1-24, May.
    14. Helder Pereira & Bruno Ribeiro & Luis Gomes & Zita Vale, 2022. "Smart Grid Ecosystem Modeling Using a Novel Framework for Heterogenous Agent Communities," Sustainability, MDPI, vol. 14(23), pages 1-20, November.
    15. Wadim Strielkowski & Andrey Vlasov & Kirill Selivanov & Konstantin Muraviev & Vadim Shakhnov, 2023. "Prospects and Challenges of the Machine Learning and Data-Driven Methods for the Predictive Analysis of Power Systems: A Review," Energies, MDPI, vol. 16(10), pages 1-31, May.
    16. Alvaro Llaria & Jessye Dos Santos & Guillaume Terrasson & Zina Boussaada & Christophe Merlo & Octavian Curea, 2021. "Intelligent Buildings in Smart Grids: A Survey on Security and Privacy Issues Related to Energy Management," Energies, MDPI, vol. 14(9), pages 1-37, May.
    17. Shruti & Shalli Rani & Aman Singh & Reem Alkanhel & Dina S. M. Hassan, 2023. "SDAFA: Secure Data Aggregation in Fog-Assisted Smart Grid Environment," Sustainability, MDPI, vol. 15(6), pages 1-15, March.
    18. Sultan Alghamdi & Hatem F. Sindi & Ahmed Al-Durra & Abdullah Ali Alhussainy & Muhyaddin Rawa & Hossam Kotb & Kareem M. AboRas, 2022. "Reduction in Voltage Harmonics of Parallel Inverters Based on Robust Droop Controller in Islanded Microgrid," Mathematics, MDPI, vol. 11(1), pages 1-30, December.
    19. Arman Goudarzi & Farzad Ghayoor & Muhammad Waseem & Shah Fahad & Issa Traore, 2022. "A Survey on IoT-Enabled Smart Grids: Emerging, Applications, Challenges, and Outlook," Energies, MDPI, vol. 15(19), pages 1-32, September.
    20. Ángeles Verdejo-Espinosa & Macarena Espinilla-Estévez & Francisco Mata Mata, 2020. "Smart Grids and Their Role in Transforming Human Activities—A Systematic Literature Review," Sustainability, MDPI, vol. 12(20), pages 1-26, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:16:y:2023:i:12:p:4654-:d:1169025. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.