Analysis of Plume Motion Characteristics in Selective Laser Melting Forming Process Based on Image Semantic Segmentation and Graph Convolution

doi:10.3901/JME.2024.12.168

Abstract

Abstract: Plume is one of the important dynamic characteristics in the process of selective laser melting . How to use plume information to study the process of selective laser melting is one of the directions that has been widely concerned in the monitoring of selective laser melting process. In order to better describe the plume information, Deeplabv3+ network is used to conduct semantic segmentation of the image to obtain the plume contour, and establish a one-dimensional plume morphological feature. At the same time, combining with the time sequence signal, a graphic structure of plume motion feature is proposed, and the melting state category is obtained by clustering. In this way, the change of plume state during processing is discussed. Graph convolution was used to encode the dynamic features of the plume to realize the feature establishment and melting state recognition. The application of graph convolution in plume feature extraction was analyzed with the output of image convolution representation features. Based on the graph convolution, the graph convolution autoencoder and classifier are built to realize the classification of melting states, and the interpretability analysis of the graph convolution is carried out. The results show that the proposed plume features have high application value in the recognition of melting states. Finally, the recognition accuracy of the five types of melting states reaches 81.52%. The interpretability analysis shows how the features of the plume characterize the melting state, which provides a new idea for the study of the plume in the selective laser melting process.

Key words: selective laser melting, graph convolution, process monitoring, plume morphology

CLC Number:

TG156

LIN Xin, MAO Yangkun, FUH Ying Hsi Jerry, ZHU Kunpeng. Analysis of Plume Motion Characteristics in Selective Laser Melting Forming Process Based on Image Semantic Segmentation and Graph Convolution[J]. Journal of Mechanical Engineering, 2024, 60(12): 168-182.

References

[1] 张家莲，李发亮，张海军. 选区激光熔化技术制备金属材料研究进展[J]. 激光与光电子学进展，2019，56(10)：35-44. ZHANG Jialian，LI Faliang，ZHANG Haijun. Research progress on preparation of metallic materials by selective laser melting[J]. Laser & Optoelectronics Progress，2019，56(10)：35-44.
[2] ZHU K，FUH J Y H，LIN X. Metal-based additive manufacturing condition monitoring：A review on machine learning based approaches [J]. IEEE/ASME Transactions on Mechatronics，2022，27(5)：2495-2510.
[3] SAHA S，ROY S. Metallic dental implants wear mechanisms，materials，and manufacturing processes：A literature review [J]. Materials，2023，16(1)：161.
[4] HUANG S，WEI H，LI D. Additive manufacturing technologies in the oral implant clinic：A review of current applications and progress[J]. Frontiers in Bioengineering and Biotechnology，2023，11：1100155.
[5] ZHANG J，SONG B，WEI Q，et al. A review of selective laser melting of aluminum alloys：Processing，microstructure，property and developing trends [J]. Journal of Materials Science & Technology，2019，35(2)：270-284.
[6] 杨益，党明珠，李伟，等. 激光选区熔化钛铝合金裂纹形成机理及抑制研究[J]. 机械工程学报，2020，56(3)：181-188. YANG Yi，DANG Mingzhu，LI Wei. Study on cracking mechanism and inhibiting process of TiAl alloys fabricated by selective laser melting[J]. Journal of Mechanical Engineering，2020，56(3)：181-188.
[7] 林鑫，黄卫东. 应用于航空领域的金属高性能增材制造技术[J]. 中国材料进展，2015，34(9)：684-688，658. LIN Xin，HUANG Weidong. High performance metal additive manufacturing technology applied in aviation field[J]. Materials China，2015，34(9)：684-688，658.
[8] 杨永强，陈杰，宋长辉，等.金属零件激光选区熔化技术的现状及进展[J]. 激光与光电子学进展，2018，55(1)：9-21. YANG Yongqiang，CHEN Jie，SONG Changhui，et al. Current status and progress on technology of selective laser melting of metal parts[J]. Laser & Optoelectronics Progress，2018，55(1)：9-21.
[9] ZHAO C，PARAB N D，LI X，et al. Critical instability at moving keyhole tip generates porosity in laser melting[J]. Science，2020，370(6520)：1080-1086.
[10] CHEN L，YAO X，XU P，et al. Rapid surface defect identification for additive manufacturing with in-situ point cloud processing and machine learning[J]. Virtual and Physical Prototyping，2021，16(1)：50-67.
[11] SHARMA S，JOSHI S S，PANTAWANE M V，et al. Multiphysics multi-scale computational framework for linking process-structure-property relationships in metal additive manufacturing：A critical review[J]. International Materials Reviews，2023，68(7)：1-67.
[12] 赵沧，杨源祺，师博，等. 金属激光增材制造微观结构和缺陷原位实时监测[J]. 科学通报，2022，67(25)：3036-3053. CANG Zhao，YANG Yuanqi，SHI Bo，et al. Operando monitoring microstructures and defects in laser fusion additive manufacturing of metals[J]. Chinese Science Bulletin，2022，67(25)：3036-3053.
[13] YANG T，JIN Y，SQUIRES B，et al. In-situ monitoring and ex-situ elasticity mapping of laser induced metal melting pool using ultrasound：Numerical and experimental approaches[J]. Journal of Manufacturing Processes，2021，71：178-186.
[14] MCCANN R，OBEIDI M A，HUGHES C，et al. In-situ sensing，process monitoring and machine control in laser powder bed fusion：A review[J]. Additive Manufacturing，2021，45：102058.
[15] WU Bo，JI Xiaoyuan，ZHOU Jianxin,et al. In situ monitoring methods for selective laser melting additive manufacturing process based on images-A review[J]. China Foundry，2021，18(4)：265-285.
[16] LIN X，ZHU K，FUH J Y H，et al. Metal-based additive manufacturing condition monitoring methods：From measurement to control[J]. ISA transactions，2022，120：147-166.
[17] LUO S Y，MA X Q，XU J，et al. Deep learning based monitoring of spatter behavior by the acoustic signal in selective laser melting[J]. Sensors，2021，21(21)：7179.
[18] YANG D，LI H，LIU S，et al. In situ capture of spatter signature of SLM process using maximum entropy double threshold image processing method based on genetic algorithm[J]. Optics & Laser Technology，2020，131：106371.
[19] TIAN Q，GUO S H，MELDER E，et al. Deep learning-based data fusion method for in situ porosity detection in laser-based additive manufacturing[J]. Journal of Manufacturing Science and Engineering，2021，143(4)：041011.
[20] LANE B，YEUNG H. Process monitoring dataset from the additive manufacturing metrology testbed (AMMT):“Three-dimensional scan strategies”[J]. Journal of Research of the National Institute of Standards and Technology，2019，124：1.
[21] HEIGEL J C，LANE B，LEVINE L，et al. In situ thermography of the metal bridge structures fabricated for the 2018 additive manufacturing benchmark test series (AM-Bench 2018)[J]. Journal of Research of the National Institute of Standards and Technology，2020，125：125005.
[22] LEVINE L，LANE B，HEIGEL J，et al. Outcomes and conclusions from the 2018 AM-Bench measurements，challenge problems，modeling submissions，and conference [J]. Integrating Materials and Manufacturing Innovation，2020，9(1)：1-15.
[23] LIN X，WANG Q S，FUH J Y H，et al. Motion feature based melt pool monitoring for selective laser melting process[J]. Journal of Materials Processing Technology，2022，303：117523.
[24] 朱锟鹏，王齐胜，林昕，等. 基于熔池运动特征的选区激光熔融过程状态检测方法[J]. 计算机集成制造系统，2021，27(12)：3403-3415. ZHU Kunpeng，WANG Qisheng，LIN Xin，et al. Selective laser melting process state monitoring method based on motion feature of melt pool[J]. Computer Integrated Manufacturing Systems，2021，27(12)：3403-3415.
[25] ZHANG Z，SAHU C K，SINGH S K，et al. Machine learning based prediction of melt pool morphology in a laser-based powder bed fusion additive manufacturing process[J]. International Journal of Production Research，2024，62(5)：1803-1817.
[26] COX M E，SCHWALBACH E J，BLAISZIK B J，et al. AFRL additive manufacturing modeling challenge series：Overview[J]. Integrating Materials and Manufacturing Innovation，2021，10(2)：125-128.
[27] 毛杨坤，段现银，林昕，等. 基于目标检测的选区激光熔融成形过程熔池与飞溅监测[J]. 机械工程学报，2023，59(9)：335-348. MAO Yangkun，DUAN Xianyin，LIN Xin，et al. Melt pool and spatter monitoring in selective laser melting forming process based on target detection[J]. Journal of Mechanical Engineering，2023，59(9)：335-348.
[28] GRASSO M，DEMIR A G，PREVITALI B，et al. In situ monitoring of selective laser melting of zinc powder via infrared imaging of the process plume [J]. Robotics and Computer-Integrated Manufacturing，2018，49：229-239.
[29] ZHANG Y，FUH J Y H，YE D，et al. In-situ monitoring of laser-based PBF via off-axis vision and image processing approaches [J]. Additive Manufacturing，2019，25：263-274.
[30] REPOSSINI G，LAGUZZA V，GRASSO M，et al. On the use of spatter signature for in-situ monitoring of laser powder bed fusion [J]. Additive Manufacturing，2017，16：35-48.
[31] YE D S，ZHU K P，FUH J Y H，et al. The investigation of plume and spatter signatures on melted states in selective laser melting [J]. Optics and Laser Technology，2019，111：395-406.
[32] GAO X D，SUN Y，KATAYAMA S. Neural network of plume and spatter for monitoring high-power disk laser welding[J]. International Journal of Precision Engineering and Manufacturing-Green Technology，2014，1(4)：293-298.
[33] CHEN X，PANG S Y，SHAO X Y，et al. Sub-microsecond vapor plume dynamics under different keyhole penetration regimes in deep penetration laser welding [J]. Journal of Physics D-Applied Physics，2017，50(20)：1-13.
[34] TAN P，KIRAN R，ZHOU K J J O M P. Effects of sub-atmospheric pressure on keyhole dynamics and porosity in products fabricated by selective laser melting [J]. Journal of Manufacturing Processes，2021，64：816-827.
[35] PODRABINNIK P A，SHTANKO A E，KHMYROV R S，et al. Interferometry of gas-phase flows during selective laser melting[J]. Applied Sciences，2019，10(1)：231.
[36] GRIGGS D A，GIBBS J S，BAKER S P，et al. A testbed for investigation of laser powder bed fusion at elevated atmospheric pressure[J]. Additive Manufacturing，2022，51：102581.
[37] WANG C M，MENG X X，HUANG W，et al. Role of side assisting gas on plasma and energy transmission during CO2 laser welding[J]. Journal of Materials Processing Technology，2011，211(4)：668-674.
[38] YIN J，HAO L，YANG L，et al. Investigation of interaction between vapor plume and spatter during selective laser melting additive manufacturing[J]. Chin. J. Lasers，2022，49：1402202.
[39] BIDARE P，BITHARAS I，WARD R M，et al. Fluid and particle dynamics in laser powder bed fusion [J]. Acta Materialia，2018，142：107-120.
[40] ZHANG Y J，YAN W T，PENG X J，et al. Investigation into the optical emission of features for powder-bed fusion AM process monitoring [J]. International Journal of Advanced Manufacturing Technology，2022，121(3-4)：2291-2303.
[41] YE D，HSI FUH J Y，ZHANG Y，et al. In situ monitoring of selective laser melting using plume and spatter signatures by deep belief networks [J]. ISA Transactions，2018，81：96-104.
[42] TAN Z，FANG Q，LI H，et al. Neural network based image segmentation for spatter extraction during laser-based powder bed fusion processing [J]. Optics & Laser Technology，2020，130：106347.
[43] FANG Q，TAN Z，LI H，et al. In-situ capture of melt pool signature in selective laser melting using U-Net-based convolutional neural network [J]. Journal of Manufacturing Processes，2021，68：347-355.
[44] MI J，ZHANG Y，LI H，et al. In-situ monitoring laser based directed energy deposition process with deep convolutional neural network[J]. Journal of Intelligent Manufacturing，2021，34(2)：683-693.
[45] ESCHNER E，STAUDT T，SCHMIDT M. Sensing approach for the in-situ determination of spatter motion within PBF-LB/M [J]. Cirp Annals-Manufacturing Technology，2022，71(1)：149-152.
[46] LI J C，CAO L C，XU J，et al. In situ porosity intelligent classification of selective laser melting based on coaxial monitoring and image processing[J]. Measurement，2022，187：110232.
[47] ZHANG Y，HONG G S，YE D，et al. Extraction and evaluation of melt pool，plume and spatter information for powder-bed fusion AM process monitoring [J]. Materials & Design，2018，156：458-469.
[48] YU B，YIN H，ZHU Z. Spatio-temporal graph convolutional networks：A deep learning framework for traffic forecasting [C]// Proceedings of the 27th International Joint Conference on Artificial Intelligence，2018：3634-3640.
[49] YAN S，XIONG Y，LIN D. Spatial temporal graph convolutional networks for skeleton-based action recognition[C/CD]//Proceedings of the AAAI Conference on Artificial Intelligence，2018.
[50] GUO W G，TIAN Q，GUO S，et al. A physics-driven deep learning model for process-porosity causal relationship and porosity prediction with interpretability in laser metal deposition [J]. CIRP Annals，2020，69(1)：205-208.
[51] ZHU Q，LIU Z，YAN J. Machine learning for metal additive manufacturing：predicting temperature and melt pool fluid dynamics using physics-informed neural networks [J]. Computational Mechanics，2021，67(2)：619-635.
[52] REN W，WEN G，ZHANG Z，et al. Quality monitoring in additive manufacturing using emission spectroscopy and unsupervised deep learning[J]. Materials and Manufacturing Processes，2022，37(11)：1339-1346.
[53] GUO H，ZHANG Y，ZHU K. Interpretable deep learning approach for tool wear monitoring in high-speed milling[J]. Computers in Industry，2022，138：103638.
[54] 蒲天骄，乔骥，赵紫璇，等. 面向电力系统智能分析的机器学习可解释性方法研究(一)：基本概念与框架[J].中国电机工程学报，2023，43(18)：7010-7029. PU Tianjiao，QIAO Ji，ZHAO Zixuan，et al. Research on interpretable methods of machine learning applied in intelligent analysis of power system (Part I)：Basic concept and framework[J]. Proceedings of the CSEE，2023，43(18)：7010-7029.
[55] CHEN L C E，ZHU Y K，PAPANDREOU G，et al. Encoder-decoder with atrous separable convolution for semantic image segmentation[C/CD]//Proceedings of the 15th European Conference on Computer Vision (ECCV)，Munich，Germany，Sep，8-14，2018.
[56] SANDLER M，HOWARD A，ZHU M，et al. Inverted residuals and linear bottlenecks：Mobile networks for classification，detection and segmentation [J/OL]//arXiv，https://doi.org/10.48550/arXiv.1801.04381.
[57] JIANG M，DONG J，MA D，et al. Inception spatial temporal graph convolutional networks for skeleton-based action recognition [C]//2022 International Symposium on Control Engineering and Robotics (ISCER)，2022：208-213.
[58] YU B，YIN H T，ZHU Z X. Spatio-temporal graph convolutional networks：A deep learning framework for traffic forecasting[C/CD]//Proceedings of the 27th International Joint Conference on Artificial Intelligence (IJCAI)，Stockholm，Sweden，Jul，13-19，2018.