SSAT: Self-Supervised Associating Network for Multiobject Tracking

Tae Young Chung, Myeong Ah Cho, Heansung Lee, Sangyoun Lee

Research output: Contribution to journalArticlepeer-review

1 Citation (Scopus)


Multi-object tracking (MOT), which is crucial for computer vision and video processing, has immense potential for improvement. Traditional tracking-by-detection approaches include feature-based object re-identification methods that use trained features, but these methods suffer from a lack of suitable training data. In training datasets used for MOT, every object in a video sequence must have its own location and ID. However, assigning IDs to each object in every sequence is considerably labor-intensive, and hence current MOT datasets are unsuitable for training re-identification networks. To resolve this issue, this paper proposes a novel self-supervised learning method using several short videos that contain no human-added labels, based on the idea that each video is a set of temporally corresponding image frames. We then describe how to improve tracking performance using a re-identification network trained in a self-supervised manner. In addition, ablation studies were conducted in order to define the optimal parameters, such as number of clips, data augmentation, and appropriate matching algorithms. The proposed approach achieved competitive performance compared with current best-practice methods including supervised methods, achieving MOT accuracy = 62.0% and ID F1-score = 62.7% on the MOT17 benchmark.

Original languageEnglish
Pages (from-to)7858-7868
Number of pages11
JournalIEEE Transactions on Circuits and Systems for Video Technology
Issue number11
Publication statusPublished - 2022 Nov 1

Bibliographical note

Publisher Copyright:
© 1991-2012 IEEE.

All Science Journal Classification (ASJC) codes

  • Media Technology
  • Electrical and Electronic Engineering


Dive into the research topics of 'SSAT: Self-Supervised Associating Network for Multiobject Tracking'. Together they form a unique fingerprint.

Cite this