Research on Plate Shape Measurement System and Calibration Method of Wide and Thick Plate

doi:10.3901/JME.2022.20.294

Abstract

Abstract: Aiming at the current demand for online intelligent detection of wide and thick plate shape, a wide and thick plate shape measurement system with single laser and multi-camera is designed, and a attitude calibration method of multi-camera coordinate system is proposed based on the unique laser plane. The plate shape measurement system is composed of two identical subsystems located before and after the wide and thick plate levelling machine. The subsystem adopts the method of multi-camera measurement vision splicing to realize the detection of wide and thick plate shape. First, using the uniqueness of the world coordinate system of the same attitude calibration plate in the common view of adjacent cameras, the coordinate systems of multiple cameras are mapped to the reference coordinate system. Then the multi-camera coordinate systems are set to the same posture according to the uniqueness of the laser plane. At last, fast stitching of point cloud data with multi-camera system is implemented according to position relation of adjacent cameras point cloud data which unified coordinate. The multi-camera structured light measurement system calibration has been finished. The experimental results show that the method is accurate and effective, which provides an effective calibration method for 3D measurement of large field of view structured light.

Key words: plate shape measurement, structural light measurement, camera calibration, attitude calibration, point cloud data

CLC Number:

TP23

LI Ziliang, WANG Tao, ZHANG Jinzhu, SHI Wei, BAI Jianxin, HUANG Qingxue. Research on Plate Shape Measurement System and Calibration Method of Wide and Thick Plate[J]. Journal of Mechanical Engineering, 2022, 58(20): 294-303.

References

[1] 马开. 煤钢去产能进入新阶段经济注入新动能[J]. 纳中国科技投资，2018(31):5-6. MA Kai. Decapacity of coal and steel enters a new stage of economic injection[J]. China Venture Capital，2018(31):5-6.
[2] 陆之瑶，吴思. 重估钢铁行业过剩产能[J]. 中国经济报告，2017(12):70-71. LU Zhiyao，WU Si. Reassessing overcapacity of steel industry[J]. China Policy Review，2017(12):70-71.
[3] 易怀安，刘坚，路恩会. 基于图像清晰度评价的磨削表面粗糙度检测方法[J]. 机械工程学报，2016，52(16):15-21. YI Huaian，LIU Jian，LU Enhui. Detection method of grinding surface roughness based on image definition evaluation[J]. Journal of Mechanical Engineering，2016，52(16):15-21.
[4] LIU Shaoli，JIN Peng，LIU Jianhua，et al. Accurate measurement method for Tube’s endpoints based on machine vision[J]. Chinese Journal of Mechanical Engineering，2017，30(1):152-163.
[5] ALAM A，O’NILS M，MANUILSKI A，et al. Limitation of a line-of-light online paper surface measurement system[J]. IEEE Sensors Journal，2014，14(8):2715-2724.
[6] QI Ouyang，CONG Wen，SONG Yongduan，et al. Approach for designing and developing high-precision integrative systems for strip flatness detection[J]. Applied Optics，2015，54(28):8429-8438.
[7] WANG Zhenzhou，ZHOU Qi，SHUANG Yongcan. Three-dimensional reconstruction with single-shot structured light dot pattern and analytic solutions[J]. Measurement，2020，151(2020):107114.1-107114.10.
[8] HUI Chen，WEN Cui. A comparative analysis between active structured light and multi-view stereo vision technique for 3D reconstruction of face model surface[J]. Optik，2020，206(2020):164190.1-164190.9.
[9] ZHANG Jing，LUO Bin，SU Xin，et al. A convenient 3D reconstruction model based on parallel-axis structured light system[J]. Optics and Lasers in Engineering，2021，138(2021):106366.1-106366.5.
[10] YU Haotian，HUANG Yu，ZHENG Dongliang，et al. Three-dimensional shape measurement technique for large-scale objects based on line structured light combined with industrial robot[J]. Optik，2020，202(2020):163656.1-163656.11.
[11] LIU Yanzhao，FU Yanjun，ZHUAN Yuhao，et al. Large depth-of-field 3D measurement with a microscopic structured-light system[J]. Optics Communications，2021，481(2021):126540.1-126540.10.
[12] PAN Xinjian，WU Jieying，LI Zhili，et al. Self-calibration for linear structured light 3D measurement system based on quantum genetic algorithm and feature matching[J]. Optik，2021，225(2021):165749.1-165749.10.
[13] 韩志彬. 5000 mm宽厚板轧机传动轴断轴分析及对策[J]. 金属材料与冶金工程，2013，41(4):41-43. HAN Zhibin. The analysis and countermeasures on the main driving shaft broken of 5 000 mm heavy plate mill[J]. Metal Materials and Metallurgy Engineering，2013，41(4):41-43.
[14] 周军. 5m以上宽厚板工作辊组织优化研究[J]. 现代冶金，2017，45(2):38-40. ZHOU Jun. Study on the structure optimization of working roller of 5m heavy plate[J]. Modern Metallurgy，2017，45(2):38-40.
[15] 王广科，苗雨川. 5m宽厚板轧机平面形状控制技术及优化[J]. 宝钢技术，2018(6):68-74. WANG Guangke，MIAO Yuchuan. Plane view shape control technology and optimization of 5 m heavy plate mill at Baosteel[J]. Bao-Steel Technology，2018(6):68-74.
[16] 周富强，张广军，江洁. 线结构光视觉传感器的现场标定方法[J]. 机械工程学报，2004，40(6):169-173. ZHOU Fuqiang，ZHANG Guangjun，JIANG jie. Field calibration method for line structured light vision sensor[J]. Journal of Mechanical Engineering，2004，40(6):169-173.
[17] 张曦，张健. 线结构光标定方法综述[J]. 激光与光电子学进展，2018，55(2):020001.1- 020001.11. ZHANG Xi，ZHANG Jian. Summary on calibration method of line-structured light[J]. Laser & Optoelectronics Progress，2018，55(2):020001.1- 020001.11.
[18] 周京博，李玥华，秦志英，等. 基于参考靶标的线结构光传感器标定[J]. 光学学报，2019，39(4):0412005.1- 0412005.8. ZHOU Jingbo，LI Yuehua，QIN Zhiying，et al. Calibration of line structured light sensor based on reference target[J]. Acta Optica Sinica，2019，39(4):0412005.1-0412005.8.
[19] XU Xiaobin，FEI Zhongwen，YANG Jian，et al. Line structured light calibration method and centerline extraction:A review[J]. Results in Physics，2020，19(2020):103637.1-103637.17.
[20] ZHENG Fei，KONG Bin. Calibration of linear structured light system by planar checkerboard[C]// IEEE International Conference on Information Acquisition. Hefei:IEEE，2004:344-346.
[21] FAN Junfeng，JING Fengshui，FANG Zaojun，et al. A simple calibration method of structured light plane parameters for welding robots[C]// 35th Chinese Control Conference (CCC). Chengdu:IEEE，2016:6127-6132.
[22] MCIVOR A M. Calibration of a laser stripe profiler[C]// IEEE Comput. Soc Second International Conference on 3-D Digital Imaging and Modeling. Ottawa，Ont:IEEE，1999:92-98.
[23] CHE Chenggang，NU Jun. A ball-target-based extrinsic calibration technique for high-accuracy 3D metrology using off-the-shelf laser-stripe sensors[J]. Precis Engineering，2000，24(3):210-219.
[24] XIE Zexiao，WANG Xiaomin，CHI Shukai. Simultaneous calibration of the intrinsic and extrinsic parameters of structured-light sensors[J]. Optics and Lasers in Engineering，2014，58:9-18.
[25] CHU C W，HWANG S，JUNG S K. Calibration-free approach to 3D reconstruction using light stripe projections on a cube frame[C]// IEEE Comput. Soc Third International Conference on 3-D Digital Imaging and Modeling. Quebec:IEEE，2001:13-19.
[26] HUYNH D Q，OWENS R A，HARTMANN P E. Calibrating a structured light stripe system:a novel approach[J]. International Journal of Computer Vision，1999，33(1):73-86.
[27] 徐光祐，刘立峰，曾建超，等. 一种新的基于结构光的三维视觉系统标定方法[J]. 计算机学报，1995，18(6):450-456. XU Guangyou，LIU Lifeng，ZENG Jianchao，et al. A new method of calibration in 3D vision system based structure-light[J]. Chinese Journal of Computers，1995，18(6):450-456.
[28] WEI Zhenzhong，XIE Meng，ZHANG Guangjun. Calibration method for line structured light vision sensor based on vanish points and lines[C]// IEEE 2010 20th International Conference on Pattern Recognition (ICPR). Istanbul，Turkey:IEEE，2010:794-797.
[29] WEI Zhenzhong，SHAO Mingwei，ZHANG Guangjun，et al. Parallel-based calibration method for line-structured light vision sensor[J]. Optical Engineering，2014，53(3):033101.1-033101.12.
[30] XU Guan，ZHANG Xinyuan，SU Jian，et al. Solution approach of a laser plane based on Plücker matrices of the projective lines on a flexible 2D target[J]. Applied Optics，2016，55(10):2653-2656.
[31] XU Guan，ZHENG Anqi，LI Xiaotao，et al. Optimization solution of laser plane generated from maximum likelihood estimation of projection plane[J]. Sensors and Materials，2018，30(5):1155-1164.
[32] 刘震，张广军，魏振忠，等. 一种高精度线结构光视觉传感器现场标定方法[J]. 光学学报，2009，29(11):3124-3128. LIU Zhen，ZHANG Guangjun，WEI Zhenzhong，et al. Primary resonance analysis of solid and liquid mixture vibration isolation system[J]. Acta Optica Sinica，2009，29(11):3124-3128.
[33] 张翰，包国琦，刘凯. 一种结构光三维成像系统的简易标定方法[J]. 激光与光电子学进展，2019，56(14):148-156. ZHANG Han，BAO Guoqi，LIU Kai. Simple calibration method for three-dimensional imaging system with structured light[J]. Laser & Optoelectronics Progress，2019，56(14):148-156.
[34] 曲学军，王勇，樊龙欣，等. 线结构光三维扫描测量中的多视数据对齐[J]. 塑性工程学报，2012，19(5):124-129. QU Xuejun，WANG Yong，FAN Longxin，et al. Alignment of multi-view data of linear structure light scanning measurement[J]. Journal of Plasticity Engineering，2012，19(5):124-129.
[35] 解则晓，刘静晓. 超大尺度线结构光传感器现场标定技术[J]. 中国激光，2015，42(12):290-296. XIE Zexiao，LIU Jingxiao. Calibration technology for line structured light sensor with large scale[J]. Chinese Journal of Lasers，2015，42(12):290-296.
[36] ZHAN Dong，YU Long，XIAO Jian，et al. Multi-camera and structured-light vision system (MSVS) for dynamic high-accuracy3D measurements of railway tunnels[J]. Sensors，2015，15(4):8664-8684.
[37] 马玉坤，王中亚，杨国威，等. 基于线结构光传感器的公路平整度测量系统[J]. 传感技术学报，2013，26(11):1597-1603. MA Yukun，WANG Zhongya，YANG Guowei，et al. A system based on structured-light sensors for measurement of pavement evenness[J]. Chinese Journal of Sensors and Actuators，2013，26(11):1597-1603.
[38] 黄邦奎，刘震，张广军. 多传感器线结构光视觉测量系统全局校准[J]. 光电子·激光，2011，22(12):1816-1820. HUANG Bangkui，LIU Zhen，ZHANG Guangjun. Global calibration of multi-sensor vision measurement system based on line structured light[J]. Journal of Optoelectronics·Laser，2011，22(12):1816-1820.
[39] 张启灿，苏显渝，邹小平. 多个线结构光传感器三维测量系统的校准[J]. 激光技术，2005，29(3):225-227. ZHANG Qican，SU Xianyu，ZOU Xiaoping. Calibration of 3-D measurement system using multi-sensor with line structured-illum inated laser[J]. Laser Technology，2005，29(3):225-227.
[40] HUANG Yinguo，LI Xinghua，CHEN Peifen. Calibration method for line-structured light multi-vision sensor based on combined target[J]. Eurasip Journal on Wireless Communications and Networking，2013，(1):92-98.
[41] 李涛涛，杨峰，许献磊. 基于多视觉线结构光传感器的大尺度测量方法[J]. 中国激光，2017，44(11):136-146. LI Taotao，YANG Feng，XU Xianlei. Method of large-scale measurement based on multi-vision line structured light sensor[J]. Chinese Journal of Lasers，2017，44(11):136-146.
[42] 彭艳，牛山. 板带轧机板形控制性能评价方法综述[J]. 机械工程学报，2017，53(6):26-44. PENG Yan，NIU Shan. Review on assessment methods for shape control performance of strip rolling mills[J]. Journal of Mechanical Engineering，2017，53(6):26-44.
[43] 张瑞峰，舒子芸，南刚雷. 一种新的线结构光标定方法[J]. 激光与光电子学进展，2019，56(22):82-89. ZHANG Ruifeng，SHU Ziyun，NAN Ganglei. Calibration method for line-structured light[J]. Laser & Optoelectronics Progress，2019，56(22):82-89.
[44] CHUM O，MATAS J. Optimal randomized RANSAC[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence，2008，30(8):1472-1482.
[45] NURUNNABI A，WEST G，BELTON D. Outlier detection and robust normal-curvature estimation in mobile laser scanning 3D point cloud data[J]. Pattern Recognition，2015，48(4):1404-1419.
[46] ZHANG Zhengyou. A flexible new technique for camera calibration[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence，2000，22(11):1330-1334.