Towards Accurate Solution of Robot Hand-eye Relationship Based on the LMI-SDP Optimization

doi:10.3901/JME.2023.17.109

Abstract

Abstract: Accurate solution of the robot hand-eye relationship (X) is extremely important for visually-guided robotic operation, and is usually symbolized by the AX=XB equation. The existing methodologies always calibrate the X matrices using the separation of the rotational and translational components, causing the calibration error accumulation. Meanwhile, the minimum singular value of the regression matrix in the derived linear equation affects the accuracy of the calibration results. To this end, a novel and generic calibration methodology is proposed for solving the AX=XBproblem using the LMI-SDP (linear matrix inequality and semi-definite programming) optimization to simultaneously calibrate the optimal solution. In this approach, the linear form of the calibration equation is retrieved by means of the Kronecker product, and formulated as a convex optimization problem involving the unknown variable matrix X combined with the QR decomposition form of the regression matrix, in which the simultaneous solution is obtained via the LMI-SDP toolbox. Through simulation analysis and calibration experiments with different noise levels and data pairs, the proposed method is compared to the iterative method and the Dual Quaternion-based approach. The results show that the proposed method outperforms traditional methods in terms of accuracy and effectiveness, and owns the signification for the generalization and application of robot hand-eye system.

Key words: simultaneous coordinate calibration, kronecker product, lmi-sdp optimization, eye-hand equation

CLC Number:

TG156

FU Zhongtao, RAO Shuhang, PAN Jianbin, LI Miao, HUANG Tao, CHEN Xubing. Towards Accurate Solution of Robot Hand-eye Relationship Based on the LMI-SDP Optimization[J]. Journal of Mechanical Engineering, 2023, 59(17): 109-115.

References

[1] 熊有伦,李文龙,陈文斌,等. 机器人学:建模、控制与视觉[M]. 2版. 武汉:华中科技大学出版社,2020. XIONG Youlun,LI Wenlong,CHEN Wenbin,et al. Robotics:Modeling,control and vision[M]. 2nd ed. Wuhan:Huazhong University of Science and Technology Press,2020.
[2] ZHI X,SCHWERTFEGER S. Simultaneous hand-eye calibration and reconstruction[C]//2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS),2017:1470-1477.
[3] SHIU Y C,AHMAD S. Calibration of wrist-mounted robotic sensors by solving homogeneous transform equations of the form AX=XB[J]. 1989(2):16-19.
[4] CHOU J C,KAMEL M. Finding the position and orientation of a sensor on a robot manipulator using quaternions[J]. The International Journal of Robotics Research,1991,10(3):240-254.
[5] TSAI R Y,LENZ R K. A new technique for fully autonomous and efficient 3d robotics hand-eye calibration[J]. IEEE Transactions on Robotics and Automation,1989,5(3):345-358.
[6] PARK F C,MARTIN B J. Robot sensor calibration:Solving AX=XB on the Euclidean group[J]. IEEE Transactions on Robotics and Automation,1994,10(5):717-721.
[7] DANIILIDIS K. Hand-eye calibration using dual quaternions[J]. The International Journal of Robotics Research,1999,18(3):286-298.
[8] FU Z,PAN J,SPYRAKOS-PAPASTAVRIDIS E,et al. A dual quaternion-based approach for coordinate calibration of dual robots in collaborative motion[J]. IEEE Robotics and Automation Letters,2020,5(3):4086-4093.
[9] BAYRO-CORROCHANO E,DANIILIDIS K,SOMMER G. Motor algebra for 3D kinematics:The case of the hand-eye calibration[J]. Journal of Mathematical Imaging and Vision,2000,13(2):79-100.
[10] ZHAO Z,LIU Y. A hand-eye calibration algorithm based on screw motions[J]. Robotica,2009,27(2):217-223.
[11] ZHAO Z. Hand-eye calibration using convex optimization[C]//2011 IEEE International Conference on Robotics and Automation,2011:2947-2952.
[12] MA Q,LI H,CHIRIKJIAN G S. New probabilistic approaches to the AX=XB hand-eye calibration without correspondence[C]//2016 IEEE International Conference on Robotics and Automation (ICRA),2016:4365-4371.
[13] HU X,OLESEN D,PER K. A novel robust approach for correspondence-free extrinsic calibration[C]//2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS),2019:1-6.
[14] WANG G,LI W,JIANG C,et al. Simultaneous calibration of multicoordinates for a dual-robot system by solving the AXB=YCZ problem[J]. IEEE Transactions on Robotics,2021,37(4):1172-1185.
[15] LIU Z,LIU X,DUAN G,et al. Precise hand-eye calibration method based on spatial distance and epipolar constraints[J]. Robotics and Autonomous Systems,2021,145:103868.
[16] SHAH M. Solving the robot-world/hand-eye calibration problem using the Kronecker product[J]. Journal of Mechanisms and Robotics,2013,5(3):031007.
[17] ZHAO Z. Simultaneous robot-world and hand-eye calibration by the alternative linear programming[J]. Pattern Recognition Letters,2019,127:174-180.
[18] ERNST F,RICHTER L,MATTHäUS L,et al. Non-orthogonal tool/flange and robot/world calibration[J]. The International Journal of Medical Robotics and Computer Assisted Surgery,2012,8(4):407-420.
[19] WANG W,LIU F,YUN C. Calibration method of robot base frame using unit quaternion form[J]. Precision Engineering,2015,41:47-54.
[20] ALI I,SUOMINEN O,GOTCHEV A,et al. Methods for simultaneous robot-world-hand-eye calibration:A comparative study[J]. Sensors,2019,19(12):2837.
[21] FU Z,PAN J,SPYRAKOS-PAPASTAVRIDIS E,et al. A lie-theory-based dynamic parameter identification methodology for serial manipulators[J]. IEEE/ASME Transactions on Mechatronics,2020,26(5):2688-2699.
[22] SOUSA C D,CORTESAO R. Physical feasibility of robot base inertial parameter identification:A linear matrix inequality approach[J]. The International Journal of Robotics Research,2014,33(6):931-944.
[23] WANG J,WU L,MENG Q H,et al. Towards simultaneous coordinate calibrations for cooperative multiple robots[C]//2014 IEEE/RSJ International Conference on Intelligent Robots and Systems,2014:410-415.