Realization of Convergent Binocular Vision Algorithm for Guiding Robot Localization

doi:10.3901/JME.2022.14.161

Abstract

Abstract: The machining quality of large and complex components highly depends on the visually-guided robot localization accuracy. Aiming at the problems of limited view field of existing parallel binocular cameras and complex scanning-reconstruction algorithms, a convergent binocular stereo vision algorithm is proposed to guide robot for precise localization. Firstly, both small hole imaging principle and triangle similarity are used to establish the imaging model of convergent binocular camera for the realization of autonomous calibration, feature matching, and extraction of the spatial position information of mark points. Secondly, the data is converted to the robot base coordinate system through the hand-eye calibration algorithm for correcting the three-dimensional model of the work-piece. Thirdly, the motion path is automatically planed to guide the robot for accurate localization. Two work-pieces, regular ceramic block and complex rail, are used for experimental verification. The results show that the average localization error of work-pieces placed in any posture within the field of view can be controlled within 4%, showing the advantages of high precision and fast running speed than the typical binocular vision algorithms, and has good application prospect.

Key words: convergent binocular vision, stereo calibration, feature matching, model correction, robot localization

CLC Number:

TP391
TP242

LIU Hongdi, Lü Rui, TIAN Linli, ZHU Dahu. Realization of Convergent Binocular Vision Algorithm for Guiding Robot Localization[J]. Journal of Mechanical Engineering, 2022, 58(14): 161-169.

References

[1] 郝大贤,王伟,王琦珑,等.复合材料加工领域机器人的应用与发展趋势[J].机械工程学报, 2019, 55(3):1-17. HAO Daxian, WANG Wei, WANG Qilong, et al. Applications and development trend of robotics in composite material process[J]. Journal of Mechanical Engineering, 2019, 55(3):1-17.
[2] 朱大虎,文志明,袭望,等.高铁白车身拉丝加工表面纹理参数化评价方法[J].华中科技大学学报, 2020, 48(11):48-53. ZHU Dahu, WEN Zhiming, XI Wang, et al. Parametric evaluation method of surface texture generated on high-speed rail body by brushing finish[J]. Journal of Huazhong University of Science and Technology, 2020, 48(11):48-53.
[3] ZHU D H, FENG X Z, XU X H, et al. Robotic grinding of complex components:a step towards efficient and intelligent machining-challenges, solutions, and applications[J]. Robotics and Computer Integrated Manufacturing, 2020, 65:101908.
[4] 朱大虎,徐小虎,蒋诚,等.复杂叶片机器人磨抛加工工艺技术研究进展[J].航空学报, 2021, 42(10):524265-24265. ZHU Dahu, XU Xiaohu, JIANG Cheng, et al. Research progress in robotic grinding technology for complex blades[J]. Acta Aeronautica et Astronautica Sinica, 2021, 42(10):524265-24265.
[5] LEE I D, SEO J H, KIM Y M, et al. Automatic pose generation for robotic 3D scanning of mechanical parts[J]. IEEE Transactions on Robotics, 2020, 36(4):1219-1238.
[6] ALARCON H J L, MAVRINAC A, CHEN X. Semiautomatic model-based view planning for active triangulation 3-D inspection systems[J]. IEEE Transactions on Mechatronics, 2015, 20(2):799-811.
[7] 赵继,赵军,张磊,等.焊缝磨抛机器人视觉算法实现及其试验研究[J].机械工程学报, 2013, 49(20):42-48. ZHAO Ji, ZHAO Jun, ZHANG Lei, et al. Vision algorithm and experimental study on the robotic weld-bead grinding and polishing system[J]. Journal of Mechanical Engineering, 2013, 49(20):42-48.
[8] 谢庚承,叶一东,李建民,等.脉冲激光测距回波特性及测距误差研究[J].中国激光, 2018, 45(6):0610001. XIE Gengcheng, YE Yidong, LI Jianmin, et al. Echo characteristics and range error for pulse laser ranging[J]. Chinese Journal of Lasers, 2018, 45(6):0610001.
[9] 季旭全,王君臣,赵江地,等.基于机器人与视觉引导的星载设备智能装配方法[J].机械工程学报, 2018, 54(23):63-72. JI Xuquan, WANG Junchen, ZHAO Jiangdi, et al. Intelligent robotic assembly method of spaceborne equipment based on visual guidance[J]. Journal of Mechanical Engineering, 2018, 54(23):63-72.
[10] 刘巍,李肖,李辉,等.基于双目视觉的数控机床动态轮廓误差三维测量方法[J].机械工程学报, 2019, 55(10):1-9. LIU Wei, LI Xiao, LI Hui, et al. Binocular vision-based three-dimensional contouring error calibration method for NC machine tools[J]. Journal of Mechanical Engineering, 2019, 55(10):1-9.
[11] SOKOLOV S, BOGUSLAVSKY A, BEKLEMICHEV N. Technology of developing the software for robots vision systems[C]//16th International Conference on Informatics in Control, Automation and Robotics, 2019:345-354.
[12] 谢核.机器人加工几何误差建模及工程应用[D].武汉:华中科技大学, 2019. XIE He. Geometric error modeling and its engineering application in robotic machining[D]. Wuhan:Huazhong University of Science and Technology, 2019.
[13] ARORA S, KUMAR S, SAHIN F. Human position detection&tracking with on-robot time-of-flight laser ranging sensors[J]. ArXiv E-Prints, 2019:243-253.
[14] LIU X J, MADHUSUDANAN H, CHEN W, et al. Fast eye-in-hand 3D scanner-robot calibration for low stitching errors[J]. IEEE Transactions on Industrial Electronics, 2020, 6(99):1-9.
[15] LIU Y T, SUN R Z, ZHANG X N, et al. An autonomous positioning method for fire robots with multi-source sensors[J]. Wireless Networks, 2021(2):1-13.
[16] 谢福贵,梅斌,刘辛军,等.一种大型复杂构件加工新模式及新装备探讨[J].机械工程学报, 2020, 56(19):70-78. XIE Fugui, MEI Bin, LIU Xinjun, et al. Novel model and equipment for machining large complex components[J]. Journal of Mechanical Engineering, 2020, 56(19):70-78.
[17] MUTTI S, NICOLA G, BESCHI M, et al. Towards optimal task positioning in multi-robot cells, using nested meta-heuristic swarm algorithms[J]. Robotics and Computer Integrated Manufacturing, 2021, 71:102131.
[18] CHANG W C. Robotic assembly of smartphone back shells with eye-in-hand visual servoing[J]. Robotics and Computer Integrated Manufacturing, 2018, 50:102-113.
[19] 孟少华,胡瑞钦,张立建,等.一种基于机器人的航天器大型部件自主装配方法[J].机器人, 2018, 40(1):81-89. MENG Shaohua, HU Ruiqin, ZHANG Lijian, et al. A method of autonomous assembly of large spacecraft components using robot[J]. Robot, 2018, 40(1):81-89.
[20] TANG Y C, LI L J, WANG C L, et al. Real-time detection of surface deformation and strain in recycled aggregate concrete-filled steel tubular columns via four-ocular vision[J]. Robotics and Computer Integrated Manufacturing, 2019, 59:36-46.
[21] 赵立明,龙大周,徐晓东,等.工业机器人加工轨迹双目3D激光扫描成像修正方法[J].智能系统学报, 2021, 16(4):690-698. ZHAO Liming, LONG Dazhou, XU Xiaodong, et al. Binocular 3D laser scanning imaging based industrial robot machining trajectory correction method[J]. CAAI Transactions on Intelligent Systems, 2021, 16(4):690-698.
[22] 韦登峰.基于双目相机和IMU融合的移动机器人SLAM算法研究[D].哈尔滨:哈尔滨工业大学, 2020. WEI Dengfeng. Research on vision SLAM algorithm of mobile robot based on the fusion of stero camera and IMU[D]. Harbin:Harbin Institute of Technology, 2020.
[23] FAN Q, GONG Z Y, ZHANG S Y, et al. A vision-based fast base frame calibration method for coordinated mobile manipulators[J]. Robotics and Computer Integrated Manufacturing, 2021, 68:102078.
[24] LI Y, YING L, PING H. Compensation method of binocular vision image with UUV roll and pitch[C]//IEEE International Conference on Mechatronics and Automation (ICMA), 2015:2352-2357.
[25] LUO Z, KE Z, WANG Z, et al. 3D pose estimation of large and complicated workpieces based on binocular stereo vision[J]. Applied Optics, 2017, 56(24):6822-6836.