View Planning for Complex Surface Measurement Considering Specular Reflections and Shadows

doi:10.3901/JME.2024.15.304

Abstract

Abstract: Aiming at the reflection and self-occlusion phenomena in 3D topography measurement of complex metal parts, a multi-view visual measurement point planning method for complex surfaces is proposed. Constraints about angle of the reachable light, field of view, depth of field, occlusion and gray value (reflection or shadow) are analyzed in detail. Also measurement quality parameters are defined. Combined with the measurement coverage, the measurement point planning model of complex surface vision is established. Given the feasible region of the model is large, initial coarse planning and subsequent stage of fine planning are developed. The coarse planning is based on generate & test while fine planning is based upon the visual cone. Finally, experiments are carried out on a turbine impeller. The results show that the proposed method can produce measurement coverage of 96.19%, and the measurement quality index can reach 85.24%. The actual test can reconstruct the morphology of the impeller, which verifies the feasibility of the developed method.

Key words: machine vision, 3D measurement, viewpoint planning, complex surface, generate &, test

CLC Number:

TH741

LUO Chen, SHAO Jiafeng, WANG Wei, ZHANG Gang, ZHOU Yijun. View Planning for Complex Surface Measurement Considering Specular Reflections and Shadows[J]. Journal of Mechanical Engineering, 2024, 60(15): 304-315.

References

[1] 李云雷，张曦，屠大维.基于立体定向靶标的探针式多视场三维视觉测量系统[J].光学精密工程，2019，27(1):34-44.LI Yunlei，ZHANG Xi，TU Dawei.Prob-based multi-view field 3D vision measurement system based on three-dimensional orientation target[J].Optics and Precision Engineering，2019，27(1):34-44.
[2] 张学昌，高学敏，邵建敏，等.基于三坐标测量仪的双目视觉测量方案及其数据分析[J].工具技术，2004，38(6):65-67.ZHANG Xuechang，GAO Xuemin，SHAO Jianmin，et al.A binocular vision measurement scheme based on three coordinate measuring instruments and its data analysis[J].Tool Technology，2004，38(6):65-67.
[3] GENG Jason.Structured-light 3D surface imaging:A tutorial[J].Advances in Optics and Photonics，2011，3(2):128-160.
[4] WU Chunghua.A general theory of three-dimensional flow in subsonic and supersonic turbomachines of axial-，radial-，and mixed-flow types[R].NACA TN2604，1952，1(1):16-18.
[5] 孙九爱，庄天戈.多眼定位器中摄像机的规划[J].上海交通大学学报，2000，1(11):1461-1463，1470.SUN Jiuai，ZHUANG Tiange.Camera Planning in multi-eye localizer[J].Journal of Shanghai Jiaotong University，2000，1(11):1461-1463，1470.
[6] OLAGUE G，MOHR R.Optimal camera placement for accurate reconstruction[J].Pattern Recongnition，2002，35(4):927-944.
[7] ALSADIK B S，GERKE M，VOSSELMAN G.Optimal camera network design for 3D modeling of cultural heritage[J].ISPRS Annals of Photogrammetry，Remote Sensing and Spatial Information Sciences，2012，I-3(1):8-11.
[8] 乔玉晶，谭世征，姜金刚.一种多视觉测量组网规划策略[J].光学学报，2018，38(5):216-223.QIAO Yujing，TAN Shizheng，JIANG Jingang.Planning strategy for multi-visual measurement networking[J].Acta Optica Sinica，2018，38(5):216-223.
[9] 陈佳毅，董明利，王君，等.大型槽式聚光器面形摄影测量网络规划方法研究[J].可再生能源，2016，34(3):353-359.CHEN Jiayi，DONG Mingli，WANG Jun，et al.Photogrammetric network design for large-scale trough concentrator surface measurement[J].Renewable Energy Resources，2016，34(3):353-359.
[10] 陈杰春，赵丽萍，张恒.立体视觉测量中的摄像机优化布局[J].机床与液压，2012，40(15):34-37.CHEN Jiechun，ZHAO Liping，ZHANG Heng.Optimal placement of cameras for stereo-vision metrology[J].Machine Toools & Hydraulics，2012，40(15):34-37.
[11] WANG Jinshan，TAO Bo，GONG Zeyu，et al.A mobile robotic measurement system for large-scale complex components based on optical scanning and visual tracking[J].Robotics and Computer-Integrated Manufacturing，2021，67(1):102010.
[12] TIAN Fang，DING Ye.A sampling-based motion planning method for active visual measurement with an industrial robot[J].Robotics and Computer-Integrated Manufacturing，2022，76(1):102322.
[13] 刘洪鹏，赵文政，刘银华，等.测量不确定度约束下的结构光检测视点规划方法[J].计算机集成制造系统，2022，28(4):1079-1086.LIU Hongpeng，ZHAO Wenzheng，LIU Yinhua，et al.Structured light detection viewpoint planning method under measurement uncertainty constraint[J].Computer Integrated Manufacturing System，2022，28(4):1079-1086.
[14] SAKANE S，ISH M，KAKIKURA M.Occlusion avoidance of visual sensors based on a hand-eye action simulator system:Heaven[J].Advanced Robotics，1987，2(2):149-165.
[15] 乔玉晶，王浩然，赵燕江.大尺寸曲面零件的双目视觉测量网络规划研究[J].仪器仪表学报，2015，36(4):913-918. QIAO Yujing，WANG Haoran，ZHAO Yanjiang.Study on binocular vision measurement network layout for large curved surface parts[J].Chinese Journal of Scientific Instrument，2015，36(4):913-918.
[16] REED M K，ALLEN P K，STAMOS I.3-D modeling from range imagery:An incremental method with a planning component[C].Proceedings of the International Conference on Recent Advances in 3-D Digital Imaging and Modeling，1997:76-83.
[17] 梁士通，杨建峰，薛彬.基于遗传算法的改进相位差法波前误差传感器技术研究[J].光学学报，2010，30(4):1015-1019.LIANG Shitong，YANG Jianfeng，XUE Bin.A new phase diversity wave-front error sensing method based on genetic algorithm[J].Acta Optica Sinica，2010，30(4):1015-1019.
[18] SCHAUFLER G，JENSEN H W.Ray tracing point sampled geometry[C]//Rendering Techniques 2000.Vienna: Springer Vienna，2000:319-328.
[19] 马国军.体素分类与Phong光照模型GPU加速体绘制[J].计算机工程与设计，2010，31(7):1529-1532.MA Guojun.Volume classification and GPU-accelerated volume rendering of Phong optical model[J].Computer Engineering and Design，2010，31(7):1529-1532.
[20] CHEN Shuzhen，LI Yufang.Automatic sensor placement for model-based robot vision[J].IEEE Transactions on Systems，Man，and Cybernetics.Part B (Cybernetics)，2004，34(1):393-408.
[21] 段裕刚，刘志兵，王西彬，等.基于可视锥理论的五轴加工刀具碰撞检验方法[J].计算机集成制造系统，2014，20(11):2814-2819.DUAN Yugang，LIU Zhibing，WANG Xibin，et al.Cutter collision analysis of five-axis machining based on visibility cone theory[J].Computer Intergrated Manufacturing Systems，2014，20(11):2814-2819.