• CN: 11-2187/TH
  • ISSN: 0577-6686

Journal of Mechanical Engineering ›› 2026, Vol. 62 ›› Issue (17): 212-223.doi: 10.3901/JME.260617

Previous Articles    

Research on Automatic Refueling Docking Method of Offshore Aircraft Based on Deep Reinforcement Learning

LENG Hao, WANG Wei, CAI Yueri   

  1. Institute of Robotics, Beihang University, Beijing 100191
  • Received:2025-12-23 Revised:2026-05-14 Published:2026-11-20

Abstract: Aiming at the problem that the aircraft refueling port deviates due to ship sway caused by ocean waves, and traditional control methods are difficult to cope with high positioning errors and random force disturbances simultaneously, this paper proposes an automatic refueling docking method for offshore aircraft based on deep reinforcement learning. A ship motion model under sea state conditions is established to clarify the position and attitude error boundaries of the manipulator end-effector caused by the ship sway. A reinforcement learning framework is constructed, taking multi-dimensional perception information as the state space and the end-effector pose increment as the action space. Additionally, a multi-dimensional reward function is designed based on fuzzy control theory to guide the system in achieving compliant docking. A simulation-to-real transfer strategy is designed, utilizing domain randomization technology to simulate physical parameters and observation noise. Based on measured data, the disturbance force of the oil pipeline is accurately modeled, and the gravity compensation of the force sensor is completed, thereby enhancing the consistency between the simulation and real environments. In view of the deviation characteristics of the refueling port in the marine environment, a deep reinforcement learning algorithm based on a fuzzy controller is adopted to train the strategy. The algorithm is tested on a simulation platform and then transferred to a physical prototype for verification. The results show that the trained strategy has excellent performance and can meet the requirements of offshore aircraft refueling scenarios.

Key words: automatic refueling, deep reinforcement learning, fuzzy control, simulation-to-real transfer

CLC Number: