Automatic Weld Defect Detection in Steel Plates Based on Ultrasonic Total Focusing Method and Multi-layer Feature Fusion Target Detection Network

doi:10.3901/JME.2025.04.055

Abstract

Abstract: Defects in metal welding structures can cause serious harm to key equipment during service. Traditional defect identification is mainly based on manual inspection. However, the amount of actual inspection data is huge, and defects vary in shape and size, making the inspection results susceptible to various influencing factors. A multi-layer feature fusion target detection network is proposed to intelligently identify the ultrasonic total-focusing image of steel plate welds. Since the proportion of defective pixels in ultrasound images is low and there are many noises and artifacts, the original VGG backbone network is replaced with a dense convolutional network with feature reuse and fewer parameters to optimize the computing resources and speed of the model. At the same time, a multi-layer network fusion module is embedded to fuse the upper and lower adjacent network feature maps, fully combining large-size features and small-size features to improve the detection ability of the model. In addition, a spatial attention mechanism is embedded to enhance defect information and suppress background noise. Finally, the intersection over union ratio non-maximum suppression algorithm in the original SSD is replaced with a distance intersection over union ratio to better detect closely spaced defects in using simulation and experiments to obtain the ultrasonic total-focusing data set of typical weld defects for model testing, the results show that the average accuracy of the model is 10.45% higher than the original SSD model, and the detection frame rate is increased by 17%. The proposed multi-layer feature fusion target detection network can be used for fast, accurate and automatic identification of large-volume ultrasonic total-focusing inspection results of welded steel structures.

Key words: total focusing method, deep learning, weld defect, feature fusion

CLC Number:

TG156

QIN Feihong, YUAN Maodan, ZHU Duanyang, LIU Xiaorui, LI Ming, JI Xuanrong. Automatic Weld Defect Detection in Steel Plates Based on Ultrasonic Total Focusing Method and Multi-layer Feature Fusion Target Detection Network[J]. Journal of Mechanical Engineering, 2025, 61(4): 55-66.

References

[1] VAN SLOUN R J G，COHEN R，ELDAR Y C. Deep learning in ultrasound imaging[J]. Proceedings of the IEEE，2019，108(1):11-29.
[2] HUANG W，KOVACEVIC R. Development of a real-time laser-based machine vision system to monitor and control welding processes[J]. The International Journal of Advanced Manufacturing Technology，2012，63:235-248.
[3] MEDAK D，POSILOVIC L，SUBASIC M，et al. Automated defect detection from ultrasonic images using deep learning[J]. IEEE Transactions on Ultrasonics，Ferroelectrics，and Frequency Control，2021，68(10):3126-3134.
[4] 李建乐，张佳奇，黄念，等. 基于深度学习的分布式光纤损伤识别方法[J]. 机械工程学报，2022，58(8):88-95. LI Jianle，ZHANG Jiaqi，HUANG Nian，et al. Distributed optical fiber damage identification method based on deep learning[J]. Journal of Mechanical Engineering，2022，58(8):88-95.
[5] 雷亚国，贾峰，周昕，等. 基于深度学习理论的机械装备大数据健康监测方法[J]. 机械工程学报，2015，51(21):49-56. LEI Yaguo，JIA Feng，ZHOU Xin，et al. A deep learning-based method for machinery health monitoring with big data[J]. Journal of Mechanical Engineering，2015，51(21):49-56.
[6] SLONSKI M，SCHABOWICZ K，KRAWCZYK E. Detection of flaws in concrete using ultrasonic tomography and convolutional neural networks[J]. Materials，2020，13(7):1557.
[7] VAN SLOUN R J G，COHEN R，ELDAR Y C. Deep learning in ultrasound imaging[J]. Proceedings of the IEEE，2019，108(1):11-29.
[8] WONG K C L，SINKOVSKAYA E S，ABUHAMAD A Z，et al. Multiview and multiclass image segmentation using deep learning in fetal echocardiography[C]//Medical Imaging 2021:Computer-Aided Diagnosis，Birmingham:Springer，2021:308-313.
[9] REDMON J，DIVVALA S，GIRSHICK R，et al. You only look once:Unified，real-time object detection[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas:IEEE，2016:779-788.
[10] REDMON J，FARHADI A. YOLO9000:better，faster，stronger[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Honolulu:IEEE，2017:7263-7271.
[11] LIU W，ANGUELOV D，ERHAN D，et al. Ssd:single shot multibox detector[C]//Computer Vision–ECCV 2016:14th European Conference. Amsterdam:Springer International Publishing，2016:21-37.
[12] REN S，HE K，GIRSHICK R，et al. Faster r-cnn:towards real-time object detection with region proposal networks[J]. IEEE Transactions on Pattern Analysis & Machine Intelligence，2017，39(6):1137-1149.
[13] HE Y，SONG K，MENG Q，et al. An end-to-end steel surface defect detection approach via fusing multiple hierarchical features[J]. IEEE Transactions on Instrumentation and Measurement，2019，69(4):1493-1504.
[14] SHARMA M，LIM J，LEE H. The amalgamation of the object detection and semantic segmentation for steel surface defect detection[J]. Applied Sciences，2022，12(12):6004.
[15] GUO Z，WANG C，YANG G，et al. Msft-yolo:Improved yolov5 based on transformer for detecting defects of steel surface[J]. Sensors，2022，22(9):3467.
[16] YANG L，WANG Z，GAO S. Pipeline magnetic flux leakage image detection algorithm based on multiscale SSD network[J]. IEEE Transactions on Industrial Informatics，2019，16(1):501-509.
[17] HUANG G，LIU Z，VAN D M L，et al. Densely connected convolutional networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Honolulu:IEEE，2017:4700-4708.
[18] HU J，SHEN L，SUN G. Squeeze-and-excitation networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Salt Lake City:IEEE，2018:7132-7141.
[19] ZHENG Z，WANG P，LIU W，et al. Distance-iou loss:faster and better learning for bounding box regression[C]//Proceedings of the AAAI Conference on Artificial Intelligence. New York:AAAI，2020:12993-13000.
[20] HOLMES C，DRINKWATER B W，WILCOX P D. Post-processing of the full matrix of ultrasonic transmit–receive array data for non-destructive evaluation[J]. NDT & e International，2005，38(8):701-711.
[21] 吴斌，杨敬，焦敬品，等. 奥氏体不锈钢小径管焊缝缺陷多模式超声复合全聚焦成像研究[J]. 机械工程学报，2020，56(14):9-18. WU Bin，YANG Jing，JIAO Jingpin，et al. Study on ultrasonic multi-mode composite total focusing imaging method for welds defect inspection in small-diameter tube of austenitic stainless steel[J]. Journal of Mechanical Engineering，2020，56(14):9-18.
[22] VELICHKO A，WILCOX P D. Reversible back-propagation imaging algorithm for postprocessing of ultrasonic array data[J]. IEEE Trans. IEEE Transactions on Ultrasonics，Ferroelectrics，and Frequency Control，2009，56(11):2492-2503.
[23] HUNTER A J，DRINKWATER B W，WILCOX P D. Autofocusing ultrasonic imagery for non-destructive testing and evaluation of specimens with complicated geometries[J]. NDT & E International，2010，43(2):78-85.
[24] ZHANG J，DRINKWATER B W，WILCOX P D. Effects of array transducer inconsistencies on total focusing method imaging performance[J]. NDT & E International，2011，44(4):361-368.
[25] GUO X，HAN Y，NIE P. Ultrasound imaging algorithm:half-matrix focusing method based on reciprocity[J]. Mathematical Problems in Engineering，2021，2021:1-11.
[26] KIM J，LEE J K，LEE K M. Accurate image super-resolution using very deep convolutional networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas:IEEE，2016:1646-1654.
[27] LIN T Y，DOLLÁR P，GIRSHICK R，et al. Feature pyramid networks for object detection[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Amsterdam:IEEE，2017:2117-2125.
[28] LI C，HUANG Y，LI H，et al. A weak supervision machine vision detection method based on artificial defect simulation[J]. Knowledge-Based Systems，2020，208:106466.