Reinforcement learning based - sliding mode control for trajectory tracking of quadrotor unmanned aerial vehicles under disturbances

  • Tran Thai Duong School of Electrical and Electronics Engineering, Hanoi University of Science and Technology
  • Do Duc Manh School of Electrical and Electronics Engineering, Hanoi University of Science and Technology
  • Nguyen Chi Nhan School of Electrical and Electronics Engineering, Hanoi University of Science and Technology
  • Le Duc Thinh Faculty of Electrical and Electronics Engineering, Thuyloi University
  • Nguyen Tung Lam School of Electrical and Electronics Engineering, Hanoi University of Science and Technology
  • Nguyen Danh Huy School of Electrical and Electronics Engineering, Hanoi University of Science and Technology
Keywords: Reinforcement learning; Sliding mode control; Optimal control; Actor/critic structure; Quadrotor unmanned aerial vehicle (QUAV).

Abstract

In this article, a reinforcement learning (RL)-based sliding mode control (SMC) is proposed for trajectory tracking of a quadrotor unmanned aerial vehicle (QUAV) under external disturbances. First, an actor-critic RL framework sliding mode control is provided to tackle the optimal control problem without external disturbances. Secondly, the simulation in an environment with disturbances is carried out to show the robustness of the proposed controller. Theoretical analysis shows that the position and attitude tracking errors converge to a preset region, and the weight estimation errors of the actor-critic networks are uniformly ultimately bounded (UUB). Finally, a comparison of the numerical simulations between the proposed controller and traditional sliding mode controller and the Backstepping (BSP) technique is provided to indicate the advantages and improved performance of the RL-based SMC.

điểm /   đánh giá
Published
2025-02-25
Section
Electronics & Automation