The Development and Application Review of iPoint3D Software for Surface Inspection

doi:10.3901/JME.2020.07.127

Abstract

Abstract: The 3D optical measuring provides a new method for the precise manufacturing, but it encounters two challenges: 1) In non-contact optical measuring, there are the problems of large-scale data, measuring noise/overlapping, uneven point density, arbitrary initial pose and intractable point-surface error calculation; 2) It requires multi-commercial software to carry out heavy human-computer interaction, due to the absence of uniform data format, special inspection database and batch processing operation. This will lead to low efficiency and consistency in practice. The large-scale data processing algorithms is systematically introduced, such as phase-shifting measuring principle is systematically introduced, differential information estimation, point simplification/smoothing, point-surface matching, point-surface error calculation, and then presents the base development hierarchy, main function module, human-machine operation interface, IPD data format and batch processing operation of iPoint3D software. Finally, this paper presents the calculation process and application effect of self-developed iPoint3D software in car-crankshaft profile inspection, aero-blade profile inspection, large-blade deformation inspection, blade allowance distribution of robotic grinding, machining path generation of robotic milling, pump-seal-groove robotic inspection and visual localization of flexible-surface conformal printing, and discusses the future development trend of complex surface parts with 3D optical measuring. *

Key words: iPoint3D software, PowerScan scanner, large-scale measuring point processing, complex surface inspection, point-surface matching, batch processing operation

CLC Number:

TP29

LI Wenlong, LI Zhongwei, MAO Jincheng. The Development and Application Review of iPoint3D Software for Surface Inspection[J]. Journal of Mechanical Engineering, 2020, 56(7): 127-150.

References

[1] LI Zhongwei,SHI Yusheng,WANG Congjun,et al. Complex object 3D measurement based on phase-shifting and a neural network[J]. Optics Communications,2009,282:2699-2706.
[2] AYUBI G A,DUARTE I,PERCIANTE C D,et al. Phase-step retrieval for tunable phase-shifting algorithms[J]. Optics Communications,2017,405:334-342.
[3] CHIEN K C,YU H Y,HSIEH CH,et al. Regional fringe analysis for improving depth measurement in phase-shifting fringe projection profilometry[J]. Measurement Science and Technology,2018,29(1):015007.
[4] 陈松林,赵吉宾,夏仁波.多频外差原理相位解包裹方法的改进[J].光学学报,2016,36(4):0412004(11 pp.). CHEN Songlin,ZHAO Jibin,XIA Renbo. Improvement of the phase unwrapping method based on multi-frequency heterodyne principle[J]. Acta Optical Siginal,2016,36(4):0412004.
[5] GOM mbH. Optical 3D metrology supports certification of Airbus A350[EB/OL](2015-11-12). https://www.capture3d.com/case-studies/aerospace/airbus-optical-3d-metrology-supports-certification-of-airbus-a350.
[6] GAO J,GINDY N,CHEN X. An automated GD & T inspection system based on non-contact 3D digitization[J]. International Journal of Production Research,2006,44(1):117-134.
[7] HEXAGON. Automated scanning solution speeds aerospace manufacturing[EB/OL] https://www.hexagonmi.com/solutions/case-studies/aerospace/automated-scanning-solution-speeds-aerospace-manufacturing.
[8] ROSS J,HARDing K,HOGARTH E. Challenges faced in applying 3D noncontact metrology to turbine engine blade inspection[C]//In:Proceedings of the SPIE-The International Society for Optical Engineering,2011,San Diego,USA,2011:81330H.
[9] WAURZYNIAK P. Aerospace automation stretches beyond drilling and filling[J]. Manufacturing Engineering,2015,155(4):73-86.
[10] 曲巍崴,董辉跃,柯映林.机器人辅助飞机装配制孔中位姿精度补偿技术[J].航空学报,2011,32(10):1951-1959. QU Weiwei,DONG Huiyue,KE Yinglin. Pose accuracy compensation technology in robot aided aircraft assembly drilling process[J]. Acta Aeronautica et Astronautica Sinica,2011,32(10):1951-1959.
[11] ZHU W D,MEI B,YAN G R,et al. Measurement error analysis and accuracy enhancement of 2D vision system for robotic drilling[J]. Robotics and Computer-Integrated Manufacturing,2014,30(2):160-171.
[12] 周煜,张万兵,杜发荣,等.散乱点云数据的曲率精简算法[J].北京理工大学学报,2010,30(7):785-789. ZHOU Yu,ZHANG Wanbing,DU Farong,et al. Algorithm for reduction of scattered point cloud data based on curvature[J]. Transactions of Beijing Institute of Technology,2010,30(7):785-789.
[13] 程云勇,张定华,卜昆,等.涡轮叶片形状检测中的模型配准控制点集选取[J].机械工程学报,2009,45(11):240-246. CHENG Yunyong,ZHANG Dinghua,BU Kun,et al. Model registration control point set selection for turbine blade shape inspection[J]. Journal of Mechanical Engineering,2009,45(11):240-246.
[14] 王仁芳,张三元,叶修梓.点模型的几何图像简化法[J].计算机辅助设计与图形学学报,2007,19(8):1022-1027. WANG Renfang,ZHANG Sanyuan,YE Xiuzi. Simplification of point-sampled model based on geometry images[J]. Journal of Computer-Aided Design & Computer Graphics,2007,19(8):1022-1027.
[15] 李启东,李文龙,周莉萍.一种曲面特征保持的航空叶片点云精简方法[J].中国机械工程,2014,25(16):2204-2212. LI Qidong,LI Wenlong,ZHOU Liping. A surface feature-preserving point cloud simplification method for aviation blades[J]. China Mechanical Engineering,2014,25(16):2204-2212
[16] SHI B Q,LIANG J,LIU Q. Adaptive simplification of point cloud using k-means clustering[J]. Computer Aided Design,2011,43(8):910-922.
[17] SONG H,FENG H Y. A global clustering approach to point cloud simplification with a specified data reduction ratio[J]. Computer Aided Design,2008,40(3):281-292.
[18] YE T,LI Y,WANG Y Q,et al. On-line point cloud data extraction algorithm for spatial scanning measurement of irregular surface in copying manufacture[J]. International Journal of Advanced Manufacturing Technology,2016,87(5-8):1891-1905.
[19] PAULY M,GROSS M,KOBBELT L P. Efficient simplification of point-sampled surfaces[C]//International IEEE Conference on Visualization & Graphics,USA,2002:163-170.
[20] 张学昌,习俊通,严隽琪.基于非均匀热传导理论的点云数据平滑处理[J].机械工程学报,2006,42(2):115-118. ZHANG Xuechang,XI Juntong,YAN Junqi. Point cloud data smoothing processing based on nonuniform heat conduction theory[J]. Journal of Mechanical Engineering,2006,42(2):115-118.
[21] 梁新合,梁晋,郭成,等.基于自适应最优邻域的散乱点云降噪技术研究[J].中国机械工程,2010,21(6):639-642. LIANG Xinhe,LIANG Jin,GUO Cheng,et al. Study on scatter point cloud denoising technology based on self-adaptive optimal neighborhood[J]. China Mechanical Engineering,2010,21(6):639-642.
[22] 林洪彬,刘彬,张玉存,等.基于局部自适应鲁棒回归的点云消噪[J].机械工程学报,2013,49(2):20-27. LIN Hongbin,LIU Bin,ZHANG Yucun,et al. Research on variable scale registration algorithm for scattered point clouds in reverse engineering[J]. Journal of Mechanical Engineering,2013,49(2):20-27.
[23] KALOGERAKIS E,NOWROUZEZAHRAI D,SIMARI P,et al. Extracting lines of curvature from noisy point clouds[J]. Computer Aided Design,2009,41(4):282-292.
[24] SUN Y J,SCHAEFER S,WANG W P. Denoising point sets via L0 minimization[J]. Computer Aided Geometric Design,2015,35-36:2-15.
[25] HUANG H,WU S H,GONG M L,et al. Edge-aware point set resampling[J]. ACM Transactions on Graphics,2013,32(1):9(10 pp.).
[26] LI W L,XIE H,ZHANG G,et al. Adaptive bilateral smoothing for a point-sampled blade surface[J]. IEEE/ASME Transactions on Mechatronics,2016,21(6):2805-2816.
[27] BESL P,MCKAY H. A method for registration of 3-D shapes[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,1992,14(2):239-256.
[28] 徐金亭,孙玉文,刘伟军.复杂曲面加工检测中的精确定位方法[J].机械工程学报,2007,43(6):175-179. XU Jinting,SUN Yuwen,LIU Weijun. Accurate localization method of machining and inspection of complex surface[J]. Journal of Mechanical Engineering,2007,43(6):175-179.
[29] 张旭东,吴国松,胡良梅,等.基于TOF三维相机相邻散乱点云配准技术研究.机械工程学报,2013,49(12):8-16. ZHANG Xudong,WU Guosong,HU Liangmei,et al. Adjacent scatter point cloud registration technology research based on three-dimensional camera of time of flight[J]. Journal of Mechanical Engineering,2013,49(12):8-16.
[30] POTTMANN H,HUANG Q X,YANG Y L,et al. Geometry and convergence analysis of algorithms for registration of 3D shapes[J]. International Journal of Computer Vision,2006,67(3):277-296.
[31] OUYANG D S,FENG H Y,JAHANGIR N A,et al. Robust initial matching of free-form objects represented by point clouds[J]. ASME Journal of Manufacturing Science and Engineering,2012,134(2):0210008.
[32] NUCHTER A,ELSEBERG J,SCHNEIDER P,et al. Study of parameterizations for the rigid body trans-formations of the scan registration problem[J]. Computer Vision and Image Understanding,2010,114(8):963-980.
[33] MAIER-HEIN L,FRANZ A M,DOS SANTOS T R,et al. Convergent iterative closest-point algorithm to accomodate anisotropic and inhomogenous localization error[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2012,34(8):1520-1532.
[34] LI W L,YIN Z P,HUANG Y A,et al. Three dimensional point-based registration algorithm based on adaptive distance function[J]. IET Computer Vision,2011,5(1):68-76.
[35] LI W L,XIE H,ZHANG G,et al. 3-D shape matching of a blade surface in robotic grinding applications[J]. IEEE/ASME Transactions on Mechatronics,2016,21(5):2294-2306.
[36] 李文龙,谢核,尹周平,等.基于方差最小化原理的三维匹配数学建模与误差分析[J].机械工程学报,2017,53(16):190-198. LI Wenlong,XIE He,YIN Zhouping,et al. Mathematical modeling and error analysis of 3D matching based on variance minimization principle[J]. Journal of Mechanical Engineering,2013,49(2):20-27.
[37] 陈满意,王建军.基于Bootstrap的曲面最佳适配不确定度评定[J].中国机械工程,2010,21(24):2918-2921 CHEN Manyi,WANG Jianjun. Uncertainty evaluation of freeform surface best fit based on bootstrap method[J]. China Mechanical Engineering,2010,21(24):2918-2921.
[38] 郑惠江,何改云,丁伯慧.离散数据环境下复杂曲面检测点布局策略研究[J].机械工程学报,2011,47(24):8-14. ZHENG Huijing,HE Gaiyun,DING Bohui. Research on sampling points distribution strategy for complex curved surfaces in dispersed data environment[J]. Journal of Mechanical Engineering,2011,47(24):8-14.
[39] 展俊德,李锡文,史铁林.立式捏合机搅拌桨曲面的NURBS表示与误差分析[J].中国机械工程,2013,24(6):826-830. ZHAN Junde,LI Xiwen,SHI Tielin. NURBS surface of vertical kneader stirring blade and its error analysis[J]. China Mechanical Engineering,2013,24(6):826-830.
[40] 张红影,李启东,李文龙,等.基于MLS的航空叶片中弧线提取方法[J].中国机械工程,2014,25(7):959-964. ZHANG Hongying,LI Qidong,LI Wenlong,et al. NURBS surface of vertical kneader stirring blade and its error analysis[J]. China Mechanical Engineering,2014,25(7):959-964.
[41] 朱利民,罗红根,丁汉.测量定位误差度量与测点布局规划[J].中国科学-E辑:技术科学,2004,47(6):676-690. ZHU Liming,LUO Honggen,DING Han. Accuracy characterization and measurement point planning for workpiece localization[J]. Science in China-Series E:Technological Sciences,2004,25(7):959-964.
[42] ZHU L M,ZHANG X M,DING H,et al. Geometry of signed point-to-surface distance function and its application to surface approximation[J]. ASME Journal of Computing and Information Science in Engineering,2010,10(4):041003.
[43] SILVA L,BELLON O R P,BOYER K L. Precision range image registration using a robust surface interpenetration measure and enhanced genetic algorithms[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2005,27(5):762-776.
[44] MAKEM J E,HENGAN O,ARMSTRONG C G. A virtual inspection framework for precision manufacturing of aerofoil components[J]. Computer Aided Design,2012,44(9):858-874.
[45] LI W L,ZHOU L P,YAN S J. A case study of blade inspection based on optical scanning method[J]. International Journal of Production Research,2015,53(7):2165-2178.
[46] 柯映林,王青,范树迁,等. RE-SOFT系统架构及关键技术[J].中国机械工程,2006,40(8):1327-1332. KE Yinglin,WANG Qing,FAN Shuqian,et al. Architecture and key techniques of feature-based reverse modeler-RE-SOFT[J]. China Mechanical Engineering,2006,40(8):1327-1332.
[47] KE Y L,FAN S Q,ZHU W D,et al. Feature-based reverse modeling strategies[J]. Computer Aided Design,2006,38(5):485-506.
[48] GHIGLIA D,PRITT M. Two-dimensional phase unw-rapping:theory,algorithms,and software[M]. New York:Wiley-Interscience,1998.
[49] 李中伟,王从军,史玉升. 3D测量系统中的高精度摄像机标定算法[J].光电工程,2008,35(4):58-63. LI Zhongwei,WANG Congjun,SHI Yusheng. High precision camera calibration algorithm for 3D measurement system[J]. Opto-Electronic Engineering,2008,35(4):58-63.
[50] ERNEST M S,SHANG Y W. Surface parameterization and curvature measurement of arbitrary 3-D objects:five practical methods. IEEE Transactions on Pattern Analysis and Machine Intelligence,1992,14(8):833-839.
[51] 丁汉,朱利民.复杂曲面数字化制造的几何学理论和方法[M].北京:科学出版社,2011. DING Han,ZHU Limin. Geometric theory and method of digital manufacturing of complex surfaces[M]. Beijing:Science Press,2011.
[52] SMITH S M,BRADY J M. SUSAN-a new approach to low level image processing[J]. International Journal of Computer Vision,1997,23(1):45-78.
[53] FLEISHMAN S,DRORI I,COHENOR D. Bilateral mesh denoising[J]. ACM Transactions on Graphics,2003,22(3):950-953.
[54] 熊有伦,李文龙,陈文斌,等.机器人学:建模、控制与视觉[M].武汉:华中科技大学出版社,2018. XIONG Youlun,LI Wenlong,CHEN Wenbin,et al. Robotics:Modeling,control and vision[M]. Wuhan:Huazhong University of Science and Technology Press,2018.
[55] XIE H,LI W L,YIN Z P,et al. Variance-minimization iterative matching method for free-form surfaces,Part I:Theory and Method[J]. IEEE Transactions on Automation Science and Engineering,2019,16(3):1192-1204.
[56] XIE H,LI W L,YIN Z P,et al. Variance-minimization iterative matching method for free-form surfaces,Part II:Experiment and Analysis. IEEE Transactions on Automation Science and Engineering,2019,Online.