• CN: 11-2187/TH
  • ISSN: 0577-6686

Journal of Mechanical Engineering ›› 2026, Vol. 62 ›› Issue (17): 81-101.doi: 10.3901/JME.260801

Previous Articles    

Data and Model Driven Embodied Perception Technology: Progress, Challenges, and Prospects

WEI Jinyu1,2, YAN Hongkun1,2, LI Dong1,2, HUA Tianyu1,2, CHANG Haonan1,2, LI Feng1,2, WANG Zhenhua1,2, SUN Lining1,2, ZHANG Chi3,4, CHEN Guodong1,2   

  1. 1. School of Mechanical and Electrical Engineering, Soochow University, Suzhou 215021;
    2. Jiangsu Key Laboratory of Embodied Intelligent Robot Technology, Suzhou 215021;
    3. Hangzhou Hikvision Robotics Co., Ltd., Hangzhou 310052;
    4. College of Intelligent System Science and Engineering, Harbin Engineering University, Harbin 150001
  • Received:2025-12-26 Revised:2026-04-23 Published:2026-11-20

Abstract: Embodied perception is the crucial link connecting an agent's behavioral decision-making with its interactions in complex physical environments. In recent years, embodied perception technology has continuously integrated achievements from fields such as robot perception, semantic understanding, and cognitive reasoning, gradually forming a distinct research direction with clear objectives and methodological frameworks. However, existing research predominantly focuses on specific task scenarios and isolated technological breakthroughs, lacking a systematic review of the embodied perception technological framework. To this end, based on the development of embodied perception technology, this study systematically summarizes the latest research progress from three dimensions. In terms of data acquisition, it reviews three mainstream methods: teleoperation collection, simulation synthesis, and Internet-based cross-domain transfer. Regarding key technological breakthroughs, it analyzes core mechanisms such as multi-modal spatio-temporal synchronization, cross-modal semantic alignment, active perception, and world model construction. Concerning evaluation benchmarks, it categorizes typical datasets including cross-platform universal benchmarks, fine manipulation benchmarks, and simulation benchmarks. Finally, it explicitly identifies the dimensional misalignment between the high-dimensional semantic space and the low-dimensional, high-frequency physical interaction space as the core bottleneck restricting the technology's engineering application. Furthermore, it explores future development paths from the perspectives of virtual-real integrated data paradigms, interactive world model deduction, and the edge-side coordination of perception and decision-making. This discussion aims to provide a systematic reference for both the theoretical research and engineering applications of embodied perception.

Key words: embodied intelligence, embodied perception technology, data acquisition methods, embodied datasets

CLC Number: