Re-identification Algorithm for Cooperative Vehicle-infrastructure System Based on Multi-information Fusion

doi:10.3901/JME.2024.16.231

Abstract

Abstract: A re-identification algorithm based on multi-information fusion is proposed to solve the problem of perception information redundancy in cooperative vehicle-infrastructure system(CVIS). The inputs of algorithm are the images and trajectories of the two observed targets. By calculating the image similarity and the trajectory similarity, and designing a fusion strategy considering multiple weights, the overall similarity of the two targets can be obtained. Then, a re-identification process is made according to overall similarity of the two targets. For the image similarity, a lightweight image similarity Siamese network is designed; for the trajectory similarity, a trajectory similarity algorithm is designed; for the fusion strategy, four kinds of weights, including image quality weight, trajectory quality weight, image similarity weight, and trajectory similarity weight, are calculated. A fusion function is proposed to realize the fusion of image and trajectory information. A platform of CVIS is built in real traffic scenario. Based on this platform, a variety of experiments under different working conditions are carried out to verify the effectiveness of the algorithm. The results show that compared to the re-identification algorithms based on single information source such as SVDNet, Cam-GAN, MultiScale, the re-identification algorithm based on multi-information fusion improves the re-identification accuracy rate by more than 30% and reduce missed detection rate by more than 20%.

Key words: cooperative vehicle-infrastructure system, re-identification, image similarity, trajectory similarity, multi-information fusion

CLC Number:

U461

QIAN Min, GENG Keke, YIN Guodong, LI Shangjie, WANG Ziwei, SUN Yuxiao. Re-identification Algorithm for Cooperative Vehicle-infrastructure System Based on Multi-information Fusion[J]. Journal of Mechanical Engineering, 2024, 60(16): 231-240.

References

[1] LI S,CHANG F,LIU C,et al. Vehicle counting and traffic flow parameter estimation for dense traffic scenes[J]. IET Intelligent Transport Systems,2020,14(12):1517-1523.
[2] LIU Y,PENG M,SHOU G,et al. Toward edge intelligence:Multiaccess edge computing for 5G and internet of things[J]. IEEE Internet of Things Journal,2020,7(8):6722-6747.
[3] MAO X,CAO J,LI D,et al. Integrating coarse granularity part-level features with supervised global-level features for person re-identification[J]. ZTE Communications,2021,19(1):72-81.
[4] LI Y,YANG M,ZHANG Z. A survey of multi-view representation learning[J]. IEEE Transactions on Knowledge and Data Engineering,2018,31(10):1863-1883.
[5] JIANG W,HUANG K,GENG J,et al. Multi-scale metric learning for few-shot learning[J]. IEEE Transactions on Circuits and Systems for Video Technology,2020,31(3):1091-1102.
[6] YU K,GUO G D,LI J,et al. Quantum algorithms for similarity measurement based on Euclidean distance[J]. International Journal of Theoretical Physics,2020,59(10):3134-3144.
[7] LI X,DENG S,LI L,et al. Outlier detection based on robust mahalanobis distance and its application[J]. Open Journal of Statistics,2019,9(1):15-26.
[8] MAGGIORI E,TARABALKA Y,CHARPIAT G,et al. Convolutional neural networks for large-scale remote-sensing image classification[J]. IEEE Transactions on Geoscience and Remote Sensing,2016,55(2):645-657.
[9] CHEN Y,HU H. Multi-layer adaptive feature fusion for semantic segmentation[J]. Neural Processing Letters,2020,51(2):1081-1092.
[10] NECULOIU P,VERSTEEGH M,ROTARU M. Learning text similarity with siamese recurrent networks[C]//Proceedings of the 1st Workshop on Representation Learning for NLP,2016:148-157.
[11] SUN Y,ZHENG L,DENG W,et al. Svdnet for pedestrian retrieval[C]//Proceedings of the IEEE International Conference on Computer Vision,2017:3800-3808.
[12] ZHONG Z,ZHENG L,ZHENG Z,et al. Camera style adaptation for person re-identification[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition,2018:5157-5166.
[13] LAN X,ZHU X,GONG S. Person search by multi-scale matching[C]//Proceedings of the European Conference on Computer Vision (ECCV),2018:536-552.
[14] GUO Q,FENG W,ZHOU C,et al. Learning dynamic siamese network for visual object tracking[C]//Proceedings of the IEEE International Conference on Computer Vision,2017:1763-1771.
[15] CHEN B,DENG W,DU J. Noisy softmax:Improving the generalization ability of dcnn via postponing the early softmax saturation[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition,2017:5372-5381.
[16] THECKEDATH D,SEDAMKAR R R. Detecting affect states using VGG16,ResNet50 and SE-ResNet50 networks[J]. SN Computer Science,2020,1(2):1-7.
[17] LIU D,CHEN X,PENG D. Some cosine similarity measures and distance measures between q-rung orthopair fuzzy sets[J]. International Journal of Intelligent Systems,2019,34(7):1572-1587.
[18] ZHENG L,SHEN L,TIAN L,et al. Scalable person re-identification:A benchmark[C]//Proceedings of the IEEE International Conference on Computer Vision,2015:1116-1124.
[19] 刘照麟,陈吉清,兰凤崇,等. 基于轨迹张量的自动驾驶复合信息综合映射方法[J]. 机械工程学报,2020,56(16):214-226. LIU Zhaolin,CHEN Jiqing,LAN Fengchong,et al. Methodology on comprehensive mapping of multi-information of autonomous driving based on trajectory tensor[J]. Journal of Mechanical Engineering,2020,56(16):214-226.
[20] 李荣粲,庄伟超,殷国栋,等. 自动驾驶赛车路径与车速协同规划方法[J]. 机械工程学报,2022,58(10):200-208. LI Rongcan,ZHUANG Weichao,YIN Guodong,et al. Simultaneous path and speed planning of driverless racing car[J]. Journal of Mechanical Engineering,2022,58(10):200-208.
[21] SARA U,AKTER M,UDDIN M S. Image quality assessment through FSIM,SSIM,MSE and PSNR-A comparative study[J]. Journal of Computer and Communications,2019,7(3):8-18.