基于双注意力机制的可见光-红外行人重识别
2024-06-17魏克铭韩星宇王辉范自柱
魏克铭 韩星宇 王辉 范自柱



摘要:【目的】由于可见光图像和红外图像之间的巨大模态差异,导致可见光-红外行人重识别是一项非常具有挑战性的图像检索问题。【方法】为了进一步减小两种模态之间的差异,重点关注行人信息,提出一种基于双注意力机制的网络结构用于可见光-红外行人重识别。一方面通过双注意力机制挖掘不同尺度的行人空间信息和增强局部特征的通道交互能力,另一方面利用全局分支和局部分支,学习多粒度的特征信息,使不同粒度信息可以相互补充,形成一个更具辨别性的特征。【结果】在两个公共数据集上的实验结果表明,该方法相较于基线有明显的提升,在RegDB数据集和SYSU-MM01数据集上均表现出理想的性能。【结论】该方法可为以后解决可见光-红外行人重识别的模态差异问题提供有效的参考。
关键词:可见光-红外行人重识别;注意力机制;缓解模态差异
中图分类号:TP391;[U-9] 文献标志码:A
文章编号:1005-0523(2024)02-0087-08
Visible-Infrared Person Re-Identification Based
on Dual Attention Mechanism
Wei Keming1, Han Xingyu2, Wang Hui2, Fan Zizhu1,2
(1. School of Science, East China Jiaotong University, Nanchang 330013, China; 2. Key Laboratory of Advanced Control
and Optimization of Jiangxi Province, East China Jiaotong University, Nanchang 330013, China)
Abstract: 【Objective】Visible-infrared person re-identification is a very challenging image retrieval problem due to the huge modal difference between visible and infrared images.【Method】In order to further reduce the difference between the two modalities and focus on pedestrian information, a network structure based on dual attention mechanism is proposed for visible-infrared person re-identification. On the one hand, through the dual attention mechanism to mine personal spatial information of different scales and enhance the channel interaction ability of local features. On the other hand, through learning multi-granular feature information through using global and local branches, different granular information can complement with each other to form a more discriminating feature. 【Result】Experimental results on two public datasets show that the proposed method has a significant improvement compared with the baseline, and shows ideal performance on both the RegDB dataset and the SYSU-MM01 dataset. 【Conclusion】The proposed method can provide an effective reference for solving the problem of modal difference of visible-infrared person re-identification in the future.
Key words: visible-infrared person re-identification; attention mechanism; mitigate modal differences
Citation format: WEI K M, HAN X Y, WANG H, et al. Visible-infrared person re-identification based on dual attention mechanism[J]. Journal of East China Jiaotong University, 2024, 41(2): 87-94.
【研究意义】行人重识别主要任务是在多个不重叠的摄像机视图中匹配特定的人,在安全领域有着不可或缺的作用,近年来行人重识别一直受到广泛的关注。它的挑战主要集中在视图、姿态、光照、遮挡、背景变化等方面,为了解决这些问题,众多学者提取出了许多解决方法,取得不错的效果。这些方法主要集中在单模态的可见光行人重识别问题上,但在实际应用中,往往需要捕捉不同场景下的行人图像,特别是在夜晚光照极弱的情况下,可见光相机很难捕捉到有效的行人信息,因此可见光-红外行人重识别就引起了众多学者的注意。……
