IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v15y2022i6p2208-d773608.html
   My bibliography  Save this article

Improvement of PMSM Sensorless Control Based on Synergetic and Sliding Mode Controllers Using a Reinforcement Learning Deep Deterministic Policy Gradient Agent

Author

Listed:
  • Marcel Nicola

    (Research and Development Department, National Institute for Research, Development and Testing in Electrical Engineering—ICMET Craiova, 200746 Craiova, Romania)

  • Claudiu-Ionel Nicola

    (Research and Development Department, National Institute for Research, Development and Testing in Electrical Engineering—ICMET Craiova, 200746 Craiova, Romania
    Department of Automatic Control and Electronics, University of Craiova, 200585 Craiova, Romania)

  • Dan Selișteanu

    (Department of Automatic Control and Electronics, University of Craiova, 200585 Craiova, Romania)

Abstract

The field-oriented control (FOC) strategy of a permanent magnet synchronous motor (PMSM) in a simplified form is based on PI-type controllers. In addition to their low complexity (an advantage for real-time implementation), these controllers also provide limited performance due to the nonlinear character of the description equations of the PMSM model under the usual conditions of a relatively wide variation in the load torque and the high dynamics of the PMSM speed reference. Moreover, a number of significant improvements in the performance of PMSM control systems, also based on the FOC control strategy, are obtained if the controller of the speed control loop uses sliding mode control (SMC), and if the controllers for the inner control loops of i d and i q currents are of the synergetic type. Furthermore, using such a control structure, very good performance of the PMSM control system is also obtained under conditions of parametric uncertainties and significant variations in the combined rotor-load moment of inertia and the load resistance. To improve the performance of the PMSM control system without using controllers having a more complicated mathematical description, the advantages provided by reinforcement learning (RL) for process control can also be used. This technique does not require the exact knowledge of the mathematical model of the controlled system or the type of uncertainties. The improvement in the performance of the PMSM control system based on the FOC-type strategy, both when using simple PI-type controllers or in the case of complex SMC or synergetic-type controllers, is achieved using the RL based on the Deep Deterministic Policy Gradient (DDPG). This improvement is obtained by using the correction signals provided by a trained reinforcement learning agent, which is added to the control signals u d , u q , and i qref . A speed observer is also implemented for estimating the PMSM rotor speed. The PMSM control structures are presented using the FOC-type strategy, both in the case of simple PI-type controllers and complex SMC or synergetic-type controllers, and numerical simulations performed in the MATLAB/Simulink environment show the improvements in the performance of the PMSM control system, even under conditions of parametric uncertainties, by using the RL-DDPG.

Suggested Citation

  • Marcel Nicola & Claudiu-Ionel Nicola & Dan Selișteanu, 2022. "Improvement of PMSM Sensorless Control Based on Synergetic and Sliding Mode Controllers Using a Reinforcement Learning Deep Deterministic Policy Gradient Agent," Energies, MDPI, vol. 15(6), pages 1-30, March.
    • Handle: RePEc:gam:jeners:v:15:y:2022:i:6:p:2208-:d:773608
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/15/6/2208/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1996-1073/15/6/2208/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Ming-Shyan Wang & Tse-Ming Tsai, 2017. "Sliding Mode and Neural Network Control of Sensorless PMSM Controlled System for Power Consumption and Performance Improvement," Energies, MDPI, vol. 10(11), pages 1-15, November.
    2. Chih-Hong Lin, 2020. "Permanent-Magnet Synchronous Motor Drive System Using Backstepping Control with Three Adaptive Rules and Revised Recurring Sieved Pollaczek Polynomials Neural Network with Reformed Grey Wolf Optimizat," Energies, MDPI, vol. 13(22), pages 1-33, November.
    3. Mengting Ye & Tingna Shi & Huimin Wang & Xinmin Li & Changliang Xia, 2019. "Sensorless-MTPA Control of Permanent Magnet Synchronous Motor Based on an Adaptive Sliding Mode Observer," Energies, MDPI, vol. 12(19), pages 1-15, October.
    4. Sandra Eriksson, 2019. "Design of Permanent-Magnet Linear Generators with Constant-Torque-Angle Control for Wave Power," Energies, MDPI, vol. 12(7), pages 1-19, April.
    5. Fardila Mohd Zaihidee & Saad Mekhilef & Marizan Mubin, 2019. "Robust Speed Control of PMSM Using Sliding Mode Control (SMC)—A Review," Energies, MDPI, vol. 12(9), pages 1-27, May.
    6. Yuan-Chih Chang & Chi-Ting Tsai & Yong-Lin Lu, 2019. "Current Control of the Permanent-Magnet Synchronous Generator Using Interval Type-2 T-S Fuzzy Systems," Energies, MDPI, vol. 12(15), pages 1-12, July.
    7. Marcel Nicola & Claudiu-Ionel Nicola, 2021. "Fractional-Order Control of Grid-Connected Photovoltaic System Based on Synergetic and Sliding Mode Controllers," Energies, MDPI, vol. 14(2), pages 1-25, January.
    8. GuangQing Bao & WuGang Qi & Ting He, 2020. "Direct Torque Control of PMSM with Modified Finite Set Model Predictive Control," Energies, MDPI, vol. 13(1), pages 1-16, January.
    9. Shuang Wang & Jianfei Zhao & Tingzhang Liu & Minqi Hua, 2019. "Adaptive Robust Control System for Axial Flux Permanent Magnet Synchronous Motor of Electric Medium Bus Based on Torque Optimal Distribution Method," Energies, MDPI, vol. 12(24), pages 1-17, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Claudiu-Ionel Nicola & Marcel Nicola, 2023. "Improved Performance for PMSM Sensorless Control Based on the LADRC Controller, ESO-Type Observer, DO-Type Observer, and RL-TD3 Agent," Mathematics, MDPI, vol. 11(15), pages 1-25, July.
    2. Yongjie Yang & Xudong Liu, 2022. "A Novel Nonsingular Terminal Sliding Mode Observer-Based Sensorless Control for Electrical Drive System," Mathematics, MDPI, vol. 10(17), pages 1-16, August.
    3. Di Liu & Junwei Cao & Mingshuang Liu, 2022. "Joint Optimization of Energy Storage Sharing and Demand Response in Microgrid Considering Multiple Uncertainties," Energies, MDPI, vol. 15(9), pages 1-20, April.
    4. Yanfei Cao & Shuxin Xiao & Zhichen Lin, 2022. "A Flying Restart Strategy for Position Sensorless PMSM Driven by Quasi-Z-Source Inverter," Energies, MDPI, vol. 15(9), pages 1-15, May.
    5. Marcel Nicola & Claudiu-Ionel Nicola, 2022. "Improvement of Linear and Nonlinear Control for PMSM Using Computational Intelligence and Reinforcement Learning," Mathematics, MDPI, vol. 10(24), pages 1-34, December.
    6. Yoon-Seong Lee & Kyoung-Min Choo & Won-Sang Jeong & Chang-Hee Lee & Junsin Yi & Chung-Yuen Won, 2023. "A Virtual Impedance-Based Flying Start Considering Transient Characteristics for Permanent Magnet Synchronous Machine Drive Systems," Energies, MDPI, vol. 16(3), pages 1-17, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jiachun Lin & Yuteng Zhao & Pan Zhang & Junjie Wang & Hao Su, 2021. "Research on Compound Sliding Mode Control of a Permanent Magnet Synchronous Motor in Electromechanical Actuators," Energies, MDPI, vol. 14(21), pages 1-17, November.
    2. Yujiao Zhao & Haisheng Yu & Shixian Wang, 2021. "An Improved Super-Twisting High-Order Sliding Mode Observer for Sensorless Control of Permanent Magnet Synchronous Motor," Energies, MDPI, vol. 14(19), pages 1-18, September.
    3. Yoon-Seong Lee & Kyoung-Min Choo & Won-Sang Jeong & Chang-Hee Lee & Junsin Yi & Chung-Yuen Won, 2023. "A Virtual Impedance-Based Flying Start Considering Transient Characteristics for Permanent Magnet Synchronous Machine Drive Systems," Energies, MDPI, vol. 16(3), pages 1-17, January.
    4. Nikola Lopac & Neven Bulic & Niksa Vrkic, 2019. "Sliding Mode Observer-Based Load Angle Estimation for Salient-Pole Wound Rotor Synchronous Generators," Energies, MDPI, vol. 12(9), pages 1-22, April.
    5. Jongwon Choi & Kwanghee Nam, 2018. "Wound Synchronous Machine Sensorless Control Based on Signal Injection into the Rotor Winding," Energies, MDPI, vol. 11(12), pages 1-20, November.
    6. Omar Sandre Hernandez & Jorge S. Cervantes-Rojas & Jesus P. Ordaz Oliver & Carlos Cuvas Castillo, 2021. "Stator Fixed Deadbeat Predictive Torque and Flux Control of a PMSM Drive with Modulated Duty Cycle," Energies, MDPI, vol. 14(10), pages 1-15, May.
    7. Ming-Fa Tsai & Chung-Shi Tseng & Po-Jen Cheng, 2021. "Implementation of an FPGA-Based Current Control and SVPWM ASIC with Asymmetric Five-Segment Switching Scheme for AC Motor Drives," Energies, MDPI, vol. 14(5), pages 1-23, March.
    8. Shuo Chen & Xiao Zhang & Xiang Wu & Guojun Tan & Xianchao Chen, 2019. "Sensorless Control for IPMSM Based on Adaptive Super-Twisting Sliding-Mode Observer and Improved Phase-Locked Loop," Energies, MDPI, vol. 12(7), pages 1-19, March.
    9. Karol Wróbel & Piotr Serkies & Krzysztof Szabat, 2020. "Model Predictive Base Direct Speed Control of Induction Motor Drive—Continuous and Finite Set Approaches," Energies, MDPI, vol. 13(5), pages 1-15, March.
    10. Liqin Wu & Hao Chen & Tingyue Yu & Chengzhi Sun & Lin Wang & Xuerong Ye & Guofu Zhai, 2023. "Robust Design Optimization of the Cogging Torque for a PMSM Based on Manufacturing Uncertainties Analysis and Approximate Modeling," Energies, MDPI, vol. 16(2), pages 1-24, January.
    11. Hassam Muazzam & Mohamad Khairi Ishak & Athar Hanif & Ali Arshad Uppal & AI Bhatti & Nor Ashidi Mat Isa, 2022. "Virtual Sensor Using a Super Twisting Algorithm Based Uniform Robust Exact Differentiator for Electric Vehicles," Energies, MDPI, vol. 15(5), pages 1-18, February.
    12. Zheng Li & Zihao Zhang & Jinsong Wang & Shaohua Wang & Xuetong Chen & Hexu Sun, 2022. "ADRC Control System of PMLSM Based on Novel Non-Singular Terminal Sliding Mode Observer," Energies, MDPI, vol. 15(10), pages 1-18, May.
    13. Zhenjie Gong & Xin Ba & Chengning Zhang & Youguang Guo, 2022. "Robust Sliding Mode Control of the Permanent Magnet Synchronous Motor with an Improved Power Reaching Law," Energies, MDPI, vol. 15(5), pages 1-13, March.
    14. Reza Jafari & Pedram Asef & Mohammad Ardebili & Mohammad Mahdi Derakhshani, 2022. "Linear Permanent Magnet Vernier Generators for Wave Energy Applications: Analysis, Challenges, and Opportunities," Sustainability, MDPI, vol. 14(17), pages 1-35, September.
    15. Teen-Hang Meen & Wenbing Zhao & Cheng-Fu Yang, 2020. "Special Issue on Selected Papers from IEEE ICKII 2019," Energies, MDPI, vol. 13(8), pages 1-5, April.
    16. Sandra Eriksson, 2019. "Permanent Magnet Synchronous Machines," Energies, MDPI, vol. 12(14), pages 1-5, July.
    17. Yashar Mousavi & Geraint Bevan & Ibrahim Beklan Küçükdemiral & Afef Fekih, 2021. "Maximum Power Extraction from Wind Turbines Using a Fault-Tolerant Fractional-Order Nonsingular Terminal Sliding Mode Controller," Energies, MDPI, vol. 14(18), pages 1-16, September.
    18. Xiaofei Zhang & Hongbin Ma, 2019. "Data-Driven Model-Free Adaptive Control Based on Error Minimized Regularized Online Sequential Extreme Learning Machine," Energies, MDPI, vol. 12(17), pages 1-17, August.
    19. Anton Dianov & Alecksey Anuchin, 2021. "Design of Constraints for Seeking Maximum Torque per Ampere Techniques in an Interior Permanent Magnet Synchronous Motor Control," Mathematics, MDPI, vol. 9(21), pages 1-21, November.
    20. Raju Ahamed & Kristoffer McKee & Ian Howard, 2022. "A Review of the Linear Generator Type of Wave Energy Converters’ Power Take-Off Systems," Sustainability, MDPI, vol. 14(16), pages 1-42, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:15:y:2022:i:6:p:2208-:d:773608. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.