Simultaneous Localization and Traversable Region Mapping Based on Pedestrian Behavior Learning

doi:10.3901/JME.2019.11.036

Abstract

Abstract: In human-robot coexist environment, autonomous mobile robots must solve the problem of traversable region perception and self-positioning. Hence proposes an algorithm of simultaneous localization and traversable region mapping based on pedestrian behavior learning. The algorithm samples the traversable region in the unstructured road environment based on pedestrian behavior learning, and uses region growing algorithm to obtain connected traversable region. On simultaneously localization and mapping, visual SLAM technology is combined with the detected pedestrian information and traversable region information. The feature points on dynamic pedestrians are excluded in the matching process, and the constant speed model + DLT algorithm and greedy search + DLT are used to speed up the matching process and enhance the robustness. In the Bundle Adjustment optimization process, different weights are given to different feature points to further improve the accuracy. The detected traversable region information is then incrementally added into the point cloud map. Experiments show that in a complex unstructured road environment, the algorithm can achieve accurately self localization and obtain traversable region mapping on the mobile robot platform.

Key words: pedestrian behavior learning, simultaneous localization and mapping, traversable region, unstructured road

CLC Number:

TP242

XING Zhiwei, ZHU Xiaorui, HE Chao. Simultaneous Localization and Traversable Region Mapping Based on Pedestrian Behavior Learning[J]. Journal of Mechanical Engineering, 2019, 55(11): 36-45.

References

[1] RAMSTROM O,CHRISTENSEN H. A method for following unmarked roads[C]//Intelligent Vehicles Symposium,2005. Proceedings IEEE. IEEE,2005:650-655.
[2] TAN C,HONG T,CHANG T,et al. Color model-based real-time learning for road following[C]//Intelligent Transportation Systems Conference,2006. ITSC'06. IEEE. IEEE,2006:939-944.
[3] ALVAREZ J M Á,LOPEZ A M. Road detection based on illuminant invariance[J]. IEEE Transactions on Intelligent Transportation Systems,2011,12(1):184-193.
[4] LU X. Self-supervised road detection from a single image[C]//Image Processing (ICIP),2015 IEEE International Conference on. IEEE,2015:2989-2993.
[5] RASMUSSEN C. Texture-based vanishing point voting for road shape estimation[C]//British Machine Vision Conference. 2004:405-430.
[6] KONG H,AUDIBERT J Y,PONCE J. General road detection from a single image[J]. IEEE Transactions on Image Processing,2010,19(8):2211-2220.
[7] CHANG C K,SIAGIAN C,ITTI L. Mobile robot monocular vision navigation based on road region and boundary estimation[C]//Intelligent Robots and Systems (IROS),2012 IEEE/RSJ International Conference on. IEEE,2012:1043-1050.
[8] ALVAREZ J M,LOPEZ A M,GEVERS T,et al. Combining priors,appearance,and context for road detection[J]. IEEE Transactions on Intelligent Transportation Systems,2014,15(3):1168-1178.
[9] DENG F,ZHU X,HE C. Vision-based real-time traversable region detection for mobile robot in the outdoors[J]. Sensors,2017,17:2101.
[10] XIAO L,DAI B,LIU D,et al. Monocular road detection using structured random forest[J]. International Journal of Advanced Robotic Systems,2016,13(3):101.
[11] ALVAREZ J M,GEVERS T,LECUN Y,et al. Road scene segmentation from a single image[C]//European Conference on Computer Vision. Berlin:Springer,2012:376-389.
[12] OLIVEIRA G L,BURGARD W,BROX T. Efficient deep models for monocular road segmentation[C]//Intelligent Robots and Systems (IROS),2016 IEEE/RSJ International Conference on. IEEE,2016:4885-4891.
[13] MUR-ARTAL R,MONTIEL J M M,TARDOS J D. ORB-SLAM:A versatile and accurate monocular SLAM system[J]. IEEE Transactions on Robotics,2015,31(5):1147-1163.
[14] KLEIN G,MURRAY D. Parallel tracking and mapping for small AR workspaces[C]//Mixed and Augmented Reality,2007. ISMAR 2007. 6th IEEE and ACM International Symposium on. IEEE,2007:225-234.
[15] MOURIKIS A I,ROUMELIOTIS S I. A multi-state constraint Kalman filter for vision-aided inertial navigation[C]//Robotics and automation,2007 IEEE international conference on. IEEE,2007:3565-3572.
[16] LEUTENEGGER S,LYNEN S,BOSSE M,et al. Keyframe-based visual-inertial odometry using nonlinear optimization[J]. The International Journal of Robotics Research,2015,34(3):314-334.
[17] ENGEL J,SCHÖPS T,CREMERS D. LSD-SLAM:Large-scale direct monocular SLAM[C]//European Conference on Computer Vision. Springer,Cham,2014:834-849.
[18] DOLLÁR P,APPEL R,BELONGIE S,et al. Fast feature pyramids for object detection[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2014,36(8):1532-1545.