人体骨骼数字孪生的构建方法及应用

doi:10.3901/JME.2022.18.218

摘要/Abstract

摘要： 新一代智能制造中始终坚持以人为本的理念，其目的是要服务与满足人们的美好生活需求。人体数字孪生作为实现人机交互、健康监测的一种有效手段，通过由物理空间至虚拟空间的动态映射，实现在生产制造活动中人-机-环境的闭环交互。本文通过分析人-机-环境融合下的人体骨骼数字孪生的构建难点，基于机理模型、人工智能算法、数据填充技术、反向运动学技术四种关键技术，提出一种面向人体骨骼的数字孪生框架；并以人体腰椎为典型案例，实现了生产过程中人体腰椎力学性能的实时监测，从而验证了所提出框架和技术路线的可行性；最后，讨论“人本智造”下的人体数字孪生的难点和未来发展方向。面向复杂的人机交互环境，实现数字孪生的远距离感知、自主学习以及智能反馈是“人本智造”背景下的必经之路。基于“以人为本”的发展理念，在生产活动中提高人体数字孪生的进一步应用，从而促进智能制造的发展和完善。

关键词: 人本智造, 人体骨骼, 数字孪生, 人机交互, 机理数据

Abstract: The new generation of intelligent manufacturing always adheres to the “human-centred” concept, and its purpose is to serve and meet people's needs for a better life. As an effective means to realize human-computer interaction and health monitoring, the human digital twin can realize dynamic mapping from physical space to virtual space for manufacturing activities. Analyzing the difficulties in the construction of the human digital twin under the integration of human-machine-environment based on four key technologies: mechanism model, artificial intelligence algorithm, data filling technology, and inverse kinematics technology, this paper proposed a novel digital twin framework for the mechanical performance of the human skeleton. The feasibility of the proposed framework and technical route is verified by taking the human lumbar spine as a typical case, which realizes the real-time monitoring of the human skeleton during the production process. Finally, the difficulties and future development directions of the human digital twin under "human-centred intelligent manufacturing" are discussed. The realization of remote perception, autonomous learning, and intelligent feedback of digital twins is an indispensable way in the context of “human-centred intelligence manufacturing” for the complex human-computer interaction. It’s excepted that this work can improve the further application of human digital twin based on the “human-centred” development concept, and promote the development and improvement of intelligent manufacturing.

Key words: human-centered intelligence manufacturing (HCIM), human skeleton, digital twin, human-machine interaction, mechanism and data

中图分类号:

宋学官, 何西旺, 李昆鹏, 来孝楠, 李忠海. 人体骨骼数字孪生的构建方法及应用[J]. 机械工程学报, 2022, 58(18): 218-228.

SONG Xueguan, HE Xiwang, LI Kunpeng, LAI Xiaonan, LI Zhonghai. Construction Method and Application of Human Skeleton Digital Twin[J]. Journal of Mechanical Engineering, 2022, 58(18): 218-228.

参考文献

[1] 周济. 智能制造--“中国制造2025”的主攻方向[J]. 中国机械工程，2015，26(17):2273-2284. ZHOU Ji. Intelligent manufacturing - Main direction of “Made in China 2025”[J]. China Mechanical Engineering，2015，26(17):2273-2284.
[2] 贺正楚，潘红玉. 德国“工业4.0”与“中国制造2025”[J]. 长沙理工大学学报，2015，30(3):103-110. HE Zhengchu，PAN Hongyu. Germany “Industry 4.0” and “Made in China 2025”[J]. Journal of Changsha University of Science and Technology，2015，30(3):103-110.
[3] ZHONG R Y，XU X，KLOTZ E，et al. Intelligent manufacturing in the context of industry 4.0:a review[J]. Engineering，2017，3(5):616-630.
[4] 张曙. 工业4.0和智能制造[J]. 机械设计与制造工程， 2014(8):1-5. ZHANG Shu. Industrial 4.0 and smart manufacturing[J]. Mechanical Design and Manufacturing Engineering，2014(8):1-5.
[5] 刘献礼，李雪冰，丁明娜，等. 面向智能制造的刀具全生命周期智能管控技术[J]. 机械工程学报，2021，57(10):196-219. LIU Xianli，LI Xuebing，DING Mingna，et al. Intelligent management and control technology of cutting tool life-cycle for intelligent manufacturing[J]. Journal of Mechanical Engineering，2021，57(10):196-219.
[6] ZHOU Ji，LI Peigen，ZHOU Yanhong，et al. Toward new-generation intelligent manufacturing[J]. Engineering，2018，4(1):11-20.
[7] 陶飞，刘蔚然，张萌，等. 数字孪生五维模型及十大领域应用[J]. 计算机集成制造系统，2019，25(1):1-18. TAO Fei，LIU Weiran，ZHANG Meng，et al. Five-dimension digital twin model and its ten applications[J]. Computer Integrated Manufacturing System，2019，25(1):1-18.
[8] 郭飞燕，刘检华，邹方，等. 数字孪生驱动的装配工艺设计现状及关键实现技术研究[J]. 机械工程学报，2019，55(17):110-132. GUO Feiyan，LIU Jianhua，ZOU Fang，et al. Research on the state-of-art，connotation and key implementation technology of assembly process planning with digital twin[J]. Journal of Mechanical Engineering，2019，55(17):110-132.
[9] LO C K，CHEN C H，ZHONG R Y. A review of digital twin in product design and development[J]. Advanced Engineering Informatics，2021，48:101297.
[10] ZHOU Ji，ZHOU Yanhong，WANG Baicun，et al. Human–cyber–physical systems (HCPSs) in the context of new-generation intelligent manufacturing[J]. Engineering，2019，5(4):624-636.
[11] 张伯鹏，汪劲松. 制造系统中知识信息与人的作用[J]. 机械工程学报，1994，30(5):61-65. ZHANG Bopeng，WANG Jinsong. Knowledge information and human function in manufacturing systems[J]. Journal of Mechanical Engineering，1994，30(5):61-65.
[12] TAO Fei，QI Qinlin，WANG Lihui，et al. Digital twins and cyber–physical systems toward smart manufacturing and industry 4.0:Correlation and comparison[J]. Engineering，2019，5(4):653-661.
[13] 王柏村，薛塬，延建林，等. 以人为本的智能制造:理念、技术与应用[J]. 中国工程科学，2020，22(4):139-146. WANG Baicun，XUE Yuan，YAN Jianlin，et al. Human-centered intelligent manufacturing:overview and perspectives[J]. Strategic Study of CAE，2020，22(4):139-146.
[14] 薛艳敏，李琳，曾庆喜. 从"人"与"机"关系看机械企业事故的预防[J]. 中国安全科学学报，2007，17(10):56-61. XUE Yanmin，LI Lin，ZENG Qingxi. Discussion of accident prevention based on design ideology of human and machine[J]. China Safety Science Journal，2007，17(10):56-61.
[15] 王柏村，黄思翰，易兵，等. 面向智能制造的人因工程研究与发展[J]. 机械工程学报，2020，56(16):240-253. WANG Baicun，HUANG Sihan，YI Bing，et al. State-of-art of human factors/ergonomics in intelligent manufacturing[J]. Journal of Mechanical Engineering，2020，56(16):240-253.
[16] GRECO A，CATERINO M，FERA M，et al. Digital twin for monitoring ergonomics during manufacturing production[J]. Applied Sciences，2020，10(21):7758.
[17] BILBERG A，MAILK A A. Digital twin driven human–robot collaborative assembly[J]. CIRP Annals，2019，68(1):499-502.
[18] 朱晓俊，李涛，王丹，等. 重点职业病监测现状及问题对策分析[J]. 中国工业医学杂志，2016，29(6):403-407. ZHU Xiaojun，LI Tao，WANG Dan，et al. Analysis on current situation in key occupational disease monitoring and countermeasures to problems[J]. Chinese Journal of Industrial Medicine，2016，29(6):403-407.
[19] BRUYNSEELS K，SANTONI DE SIO F，VAN DEN HOVEN J. Digital twins in health care:ethical implications of an emerging engineering paradigm[J]. Frontiers in genetics，2018，9:31.
[20] LIU Ying，ZHANG Lin，YANG Yuan，et al. A novel cloud-based framework for the elderly healthcare services using digital twin[J]. IEEE Access，2019，7:49088-49101.
[21] 张捷，钱虹，周宏远. 数字孪生技术在社区老年人安全健康监测领域的应用探究[J]. 中国医疗器械杂志，2019，43(6):410-413，421. ZHANG Jie，QIAN Hong，ZHOU Hongyuan. Application and research of digital twin technology in safety and health monitoring of the elderly in community[J]. Chinese Journal of Medical Instrumentation，2019，43(6):410-413，421.
[22] ONAN D H，IRSHAD L，AHMED S，et al. Digital Twin-driven human-centered design frameworks for meeting sustainability objectives[J]. Journal of Computing and Information Science in Engineering，2021，21(3):031012.
[23] MARTINEZ V R，GAMEZ R，EL SADDIK A. Cardio Twin:A digital twin of the human heart running on the edge[C]//2019 IEEE International Symposium on Medical Measurements and Applications (MeMeA). June 26-28，2019，Istanbul，Turkey. New York:IEEE，2019:1-6.
[24] FENG Yu，CHEN Xiaole，ZHAO Jianan. Create the individualized digital twin for noninvasive precise pulmonary healthcare[J]. Significances Bioengineering & Biosciences，2018，1(2):1-5.
[25] 李浩，刘根，文笑雨，等. 面向人机交互的数字孪生系统工业安全控制体系与关键技术[J]. 计算机集成制造系统，2021，27(2):374-389. LI Hao，LIU Gen，WEN Xiaoyu，et al. Industrial safety control system and key technologies of digital twin system oriented to human‐machine interaction[J]. Computer Integrated Manufacturing System，2021，27(2):374-389.
[26] 聂文忠. 脊柱胸腰部的生物力学建模与应用研究-中国力学虚拟人的基本问题初探[D]. 上海:上海交通大学，2009. NIE Wenzhong. Research on thoracolumbar biomechanical modeling and application--basic issue of mechanical visible human of China[D]. Shanghai:Shanghai Jiao Tong University，2009.
[27] TAKASHIMA S T，SINGH S P，HADERSPECK K A，et al. A model for semi-quantitative studies of muscle actions[J]. Journal of Biomechanics，1979，12(12):929-939.
[28] RASHEED A，SAN O，KVAMSDAL T. Digital twin:values，challenges and enablers from a modeling perspective[J]. IEEE Access，2020(8):21980-22012.
[29] WANG Xu，WANG Tianyang，MING Anbo，et al. Deep spatiotemporal convolutional-neural-network based remaining useful life estimation of bearings[J]. Chinese Journal of Mechanical Engineering，2021，34(1):1-15.
[30] 何志昆，刘光斌，赵曦晶，等. 高斯过程回归方法综述[J]. 控制与决策，2013(8):1121-1129，1137. HE Zhikun，LIU Guangbin，ZHAO Xijing，et al. Overview of Gaussian process regression[J]. Control and Decision，2013(8):1121-1129，1137.
[31] 熊中敏，郭怀宇，吴月欣. 缺失数据处理方法研究综述[J]. 计算机工程与应用，2021，57(14):27-38. XIONG Zhongmin，GUO Huaiyu，WU Yuexin. Review of missing data processing methods[J]. Computer Engineering and Applications，2021，57(14):27-38.
[32] 阮嘉琨，蔡延光，蔡颢，等. 基于优化最大偏差相似性准则的KNN缺失数据填充算法[J]. 自动化与信息工程，2020，41(2):8-15. RUAN Jiakun，CAI Yanguang，CAI Hao，et al. KNN Missing data filling algorithm based on optimized maximum deviation similarity criterion[J]. Automation and Information Engineering，2020，41(2):8-15.
[33] XU Xiaolong，CHONG Weizhi，LI Shancang，et al. MIAEC:Missing data imputation based on the evidence chain[J]. IEEE Access，2018(6):12983-12992.
[34] 徐少帅. 基于反向运动学的运动重定向研究[D]. 大连:大连理工大学，2018. XU Shaoshuai. A motion retargeting research based on inverse kinematic[D]. Dalian:Dalian University of Technology，2018.
[35] RAPETTI L，TIRUPACHURI Y，DARVISH K，et al. Model-based real-time motion tracking using dynamical inverse kinematics[J]. Algorithms，2020，13(10):266.
[36] PUJIANTO U，WIBAWA A P，AKBAR M I. K-nearest neighbor (K-NN) based missing data imputation[C]//2019 5th International Conference on Science in Information Technology (ICSITech). Oct 23-24，2019，Yogyakarta，Indonesia，New York:IEEE，2019:83-88.
[37] LENG Jiewu，ZHANG Hao，YAN Douxi，et al. Digital twin-driven manufacturing cyber-physical system for parallel controlling of smart workshop[J]. Journal of Ambient Intelligence and Humanized Computing，2019，10(3):1155-1166.
[38] 刘世民，孙学民，陆玉前，等. 知识驱动的加工产品数字孪生拟态建模方法[J]. 机械工程学报，2021，57(23): 182-194. LIU Shimin，SUN Xuemin，LU Yuqian，et al. A knowledge-driven digital twin modeling method for machining products based on biomimicry[J]. Journal of Mechanical Engineering，2021，57(23):182-194.
[39] ZHANG Jianjing，GAO R X. Deep learning-driven data curation and model interpretation for smart manufacturing[J]. Chinese Journal of Mechanical Engineering，2021，34(1):1-21.
[40] 吴少波，丑武胜，牛建伟. 基于移动机器人的无线传感器网络高效广播策略[J]. 机械工程学报，2017，53(21):16-23. WU Shaobo，CHOU Wusheng，NIU Jianwei. Efficient flooding strategy in wireless sensor networks with mobile robots[J]. Journal of Mechanical Engineering，2017，53(21):16-23.
[41] 王柏村，臧冀原，屈贤明，等. 基于人-信息-物理系统(HCPS)的新一代智能制造研究[J]. 中国工程科学，2018，20(4):29-34. WANG Baicun，ZANG Jiyuan，QU Xianming，et al. Research on new-generation intelligent manufacturing based on human-cyber-physical systems[J]. Strategic Study of CAE，2018，20(4):29-34.
[42] 陶飞，戚庆林. 面向服务的智能制造[J]. 机械工程学报，2018，54(16):11-23. TAO Fei，QI Qinglin. Service-oriented smart manufacturing[J]. Journal of Mechanical Engineering，2018，54(16):11-23.