Fault Detection Method of Railway Fastener Combined with Multi-sensor Information

doi:10.3901/JME.2021.20.038

Abstract

Abstract: The defect detection of railway fastener based on machine vision has replaced manual detection and improved the detection efficiency. However, the problems including few samples of defective railway fastener, the difficulty of sample labeling and the great influence of light conditions on 2D image detection are still the main obstacles in defect detection of railway fastener. Therefore, a defective railway fastener detection method combining multi-sensor information is proposed. The sample of railway fastener is quickly and efficiently collected by structural light equipment. An adaptive positioning and segmentation method based on depth map was designed to automatically and accurately locate and segment railway fastener in depth map, and the positioning and segmentation parameters were integrated to realize the positioning and segmentation of railway fastener on the intensive map. To solve the problem of unbalanced samples and low efficiency of sample labeling, DCGAN is used to expand the number of samples of defective railway fastener. In addition, a depth neural network with a total of 18 layers of 8 residual blocks was designed based on ResNet network to complete the detection of three types of defects:missing nut, broken spring strip and missing spring strip of railway fastener, and samples of WJ-7 type railway fastener were collected for experiment to verify the proposed method. The results showed that the average accuracy of defect detection of fastener was 97.6%, meeting the needs of engineering applications.

Key words: railway fasten, fault detection, imbalance sample, deep learning

CLC Number:

U216

JIN Peng, HUANG Hao, LIU Jianhua, LIU Shaoli, FANG Yue, HE Sen, QI Huizhi, LIU Wei. Fault Detection Method of Railway Fastener Combined with Multi-sensor Information[J]. Journal of Mechanical Engineering, 2021, 57(20): 38-46.

References

[1] 肖新标,金学松,温泽峰. 钢轨扣件失效对列车动态脱轨的影响[J]. 交通运输工程学报,2006,6(1):10-15. XIAO Xinbiao,JIN Xuesong,WEN Zefeng. Influence of rail fastener failure on vehicle dynamic derailment[J]. Journal of the Traffic and Transportation Engineering, 2006,6(1):10-15.
[2] ZHOU L,SHEN Z Y. Dynamic analysis of a high-speed train operating on a curved track with failed fasteners[J]. Journal of Zhejiang University:Science A,2013,14(6):447-458.
[3] XIAO X,JIN X,WEN Z. Effect of disabled fastening systems and ballast on vehicle derailment[J]. Journal of Vibration and Acoustics,2006,129(2):217-229.
[4] MORALES-IVORRA S,REAL J I,HERNÁNDEZ C,et al. Derailment risk and dynamics of railway vehicles in curved tracks:Analysis of the effect of failed fasteners[J]. Journal of Modern Transportation,2016,24(1):38-47.
[5] ESVELD C. Modern railway track[M]. Zaltbommel:MRT-productions,2001.
[6] MAO Q,CUI H,HU Q,et al. A rigorous fastener inspection approach for high-speed railway from structured light sensors[J]. ISPRS Journal of Photogrammetry and Remote Sensing,2018,143:249-267.
[7] 代先星,阳恩慧,WANG K C,等. 铁路扣件缺陷自动检测研究进展[J]. 铁道科学与工程学报,2017,14(11):2452-2459. DAI Xianxing,YANG Enhui,WANG K C,et al. Technology progress of automatic railway fastener inspection[J]. Journal of Railway Science and Engineering,2017,14(11):2452-2459.
[8] SHOLL H,AMMAR R,GREENSHIELDS I,et al. Application of computing analysis to real-time railroad track inspection[C/CD]//2006 World Automation Congress,24-26 Jul. 2006,Budapest,Hungary,2006.
[9] SINGH M,SINGH S,JAISWAL J,et al. Autonomous rail track inspection using vision based system[C/CD]//2006 IEEE International Conference on Computational Intelligence for Homeland Security and Personal Safety,16-17 Oct. 2006,Alexandria,VA,USA,2006.
[10] XIE Y,TALBOT M,ZHAO K,et al. Automatic track inspection using 3D laser profilers to improve rail transit asset condition assessment and state of good repair:A preliminary study[C/CD]//TRB 2014 Annual Meeting,2014.
[11] 许贵阳,史天运,任盛伟,等. 基于计算机视觉的车载轨道巡检系统研制[J]. 中国铁道科学,2013(1):139-144. XU Guiyang,SHI Tianyun,REN Shengwei,et al. Development of the on-board track inspection system based on computer vision[J]. China Railway Science, 2013(1):139-144.
[12] MARINO F,DISTANTE A,MAZZEO P L,et al. A real-time visual inspection system for railway maintenance:Automatic hexagonal-headed bolts detection[J]. IEEE Transactions on Systems Man & Cybernetics Part C,2007,37(3):418-428.
[13] RESENDIZ E,HART J M,AHUJA N. Automated visual inspection of railroad tracks[J]. IEEE Transactions on Intelligent Transportation Systems,2013,14(2):751-760.
[14] XIA Y,XIE F,JIANG Z. Broken railway fastener detection based on adaboost algorithm[C]//International Conference on Optoelectronics and Image Processing,11-12 Nov. 2010,Haikou,China,2010.
[15] FENG H,JIANG Z,XIE F,et al. Automatic fastener classification and defect detection in vision-based railway inspection systems[J]. IEEE Transactions on Instrumentation & Measurement,2014,63(4):877-888.
[16] GIBERT X,PATEL V M,CHELLAPPA R. Robust fastener detection for autonomous visual railway track inspection[C/CD]//IEEE Winter Conference on Applications of Computer Vision,5-9 Jan,2015,Waikoloa,HI,USA,2015.
[17] FAN H,PAMELA C C,YUN H,et al. High speed railway fastener detection based on line local binary pattern[J]. IEEE Signal Processing Letters,2018,25(6):788-792.
[18] 代先星,阳恩慧,丁世海,等. 基于三维图像的铁路扣件缺陷自动识别算法[J]. 铁道学报,2017,39(10):89-96. DAI Xianxing,YANG Enhui,DING Shihai,et al. Automatic defect inspection algorithm of railway fasteners based on 3D images[J]. Journal of the China Railway Society,2017,39(10):89-96.
[19] AYTEKIN A,REZAEITABAR Y,DOGRU S,et al. Railway fastener inspection by real-time machine vision[J]. IEEE Transactions on Systems,Man,and Cybernetics:Systems, 2017,45(7):1101-1107.
[20] LORENTE A G,LLORCA D F,VELASCO M G,et al. Range-based rail gauge and rail fasteners detection using high-resolution 2D/3D images[C]//TRB 2014 Annual Meeting. TRB2014,January 12-16,Washington,D.C.,United States,2014:125-132.
[21] CUI H,HU Q,MAO Q. Real-time geometric parameter measurement of high-speed railway fastener based on point cloud from structured light sensors[J]. Sensors,2018,18(11):3675.
[22] HAN Q,WANG S,FANG Y,et al. A rail fastener tightness detection approach using multi-source visual sensor[J]. Sensors,2020,20(5):1367.
[23] SHORTEN C,KHOSHGOFTAAR T M. A survey on image data augmentation for deep learning[J]. Journal of Big Data,2019,6:60.
[24] GOODFELLOW I,POUGET-ABADIE J,MIRZA M,et al. Generative adversarial nets[C]//Advances in neural information processing systems,NIPS2014,December 8-13,Montreal,Quebec,Canada,2014:2672-2680.
[25] CRESWELL A,WHITE T,DUMOULIN V,et al. Generative adversarial networks:An overview[J]. IEEE Signal Processing Magazine,2018,35(1):53-65.
[26] LEE S,PARK W,JUNG S,et al. Fault detection of aircraft system with random forest algorithm and similarity measure[J]. Scientific World Journal,2014,6:727359.
[27] LIU H,ZHOU J,XU Y,et al. Unsupervised fault diagnosis of rolling bearings using a deep neural network based on generative adversarial networks[J]. Neurocomputing,2018,315(13):412-424.
[28] ZAREAPOOR M,SHAMSOLMOALI P,YANG J. Oversampling adversarial network for class-imbalanced fault diagnosis[J]. Mechanical Systems and Signal Processing,2021,149:107175.