• CN: 11-2187/TH
  • ISSN: 0577-6686

Journal of Mechanical Engineering ›› 2022, Vol. 58 ›› Issue (14): 25-34.doi: 10.3901/JME.2022.14.025

Previous Articles     Next Articles

Vision Based Approach for Localization of Mobile Machining Robots

FU Jinsheng1, DING Yabin1, LIU Haitao1, XIAO Juliang1, HUANG Tian1,2   

  1. 1. Key Laboratory of Mechanisms Theory and Equipment Design of Ministry of Education, Tianjin University, Tianjin 300072;
    2. School of Engineering, The University of Warwick, Coventry CV4 7AL, UK
  • Received:2021-10-14 Revised:2022-02-25 Online:2022-07-20 Published:2022-09-07

Abstract: In order to meet the needs for large structural component machining in situ, this paper presents a vision based approach for determining the relative pose between the workpiece frame and the base frame of a hybrid robot mounted on an automated guide vehicle(AGV). Drawing mainly on screw theory, the deviation between the poses respectively obtained by a laser tracker and by a 3D vision sensor is modeled as a linear function of the motion errors of the actuated and virtual joints. These motion errors are then approximated by the second-order response surfaces expressed in terms of nominal actuated joint variables, whose coefficients can be estimated by solving a multiple linear regression problem in an off-line manner. Consequently, once the pose of the workpiece frame relative to the vision frame is captured by vision measurements at one pose, the pose of the robot base frame relative to the workpiece frame can be determined in an on-line manner. Experiments on a prototype machine are carried out to verify the effectiveness of the proposed approach.

Key words: mobile machining robots, kinematic calibration, vision localization

CLC Number: