韩明 王景芹 王敬涛 孟军英 刘教民

摘 要：近年来，基于孪生网络的目标跟踪算法由于在跟踪精度和跟踪效率之间能够实现良好的平衡而备受关注。通过对基于孪生网络的目标跟踪算法的文献进行归纳，对现有孪生网络目标跟踪算法进行了全面总结，对孪生网络的2个分支结构进行了讨论。首先，介绍了基于孪生网络目标跟踪的基本架构，重点分析了孪生网络中主干网络的优化，以及主干网络的目标特征提取问题。其次，对目标跟踪过程中的分类和回归2个任务展开讨论，将其分为有锚框和无锚框2大类来进行分析研究，通过实验对比，分析了算法的优缺点及其目标跟踪性能。最后，提出未来的研究重点：1）探索背景信息训练，实现场景中背景信息传播，充分利用背景信息实现目标定位。2）目标跟踪过程中，目标特征信息的更加丰富化和目标跟踪框的自适应变化。3）从帧与帧之间全局信息传播，到目标局部信息传播的研究，为准确定位跟踪目标提供支撑。

关键词：计算机图象处理;目标跟踪;孪生网络;深度学习;特征提取

中图分类号：TN520   文献标识码：A

DOI：10.7535/hbkd.2022yx01004

收稿日期：2021-08-04;修回日期：2021-12-20;責任编辑：王淑霞

基金项目：河北省高等学校科学技术研究重点项目（ZD2020405）;河北省“三三三人才工程”资助项目（A202101102）;石家庄市科学技术研究与发展计划项目（201130181A）

第一作者简介：韩 明（1984—），男，河北行唐人，副教授，博士，主要从事计算机视觉、图像处理方面的研究。

通讯作者：王景芹教授。E-mail：jqwang@hebut.edu.cn

Comprehensive survey on target tracking based on Siamese network

HAN Ming1，2，WANG Jingqin2，WANG Jingtao1，MENG Junying1，LIU Jiaomin2

（1.School of Computer Science and Engineering，Shijiazhuang University，Shijiazhuang，Hebei 050035，China;2.State Key Laboratory of Reliability and Intelligence of Electrical Equipment，Hebei University of Technology，Tianjin 300130，China）

Abstract：In recent years，the target tracking algorithm based on Siamese network has attracted much attention because it can achieve a good balance between tracking accuracy and tracking efficiency.Through the intensive study of the literature of target tracking algorithm based on Siamese network，the existing target tracking algorithm based on Siamese network was comprehensively summarized.Firstly，the basic framework of target tracking was introduced based on Siamese network，and the optimized backbone network in Siamese network and its target feature extraction were analyzed.Secondly，the classification and regression tasks in the process of target tracking were discussed，which were divided into two categories of anchor frame and anchor-free frame.The advantages and disadvantages of the algorithm as well as the target tracking performance were analyzed through experimental comparison.Finally，the focus of future research is proposed as following：1） Explore the training of background information，realize the dissemination of background information in the scene，and make full use of background information to achieve target positioning.2） In the process of target tracking，the target feature information is enriched and the target tracking frame is changed adaptively.3） Research from the global information transmission between frames to the target local information transmission provides support for the accurate target positioning and tracking.

Keywords：

computer image processing;target tracking;Siamese network;deep learning;feature extraction

视觉目标跟踪是人机交互、视觉分析和辅助驱动系统应用中最基本的问题，也是计算机视觉中一项基本又具挑战性的任务。……