VOSTR: Video Object Segmentation via Transferable Representations

Yi Wen Chen, Yi Hsuan Tsai, Yen Yu Lin, Ming Hsuan Yang

Research output: Contribution to journalArticle

Abstract

In order to learn video object segmentation models, conventional methods require a large amount of pixel-wise ground truth annotations. However, collecting such supervised data is time-consuming and labor-intensive. In this paper, we exploit existing annotations in source images and transfer such visual information to segment videos with unseen object categories. Without using any annotations in the target video, we propose a method to jointly mine useful segments and learn feature representations that better adapt to the target frames. The entire process is decomposed into three tasks: (1) refining the responses with fully-connected CRFs, (2) solving a submodular function for selecting object-like segments, and (3) learning a CNN model with a transferable module for adapting seen categories in the source domain to the unseen target video. We present an iterative update scheme between three tasks to self-learn the final solution for object segmentation. Experimental results on numerous benchmark datasets demonstrate that the proposed method performs favorably against the state-of-the-art algorithms.

Original languageEnglish
Pages (from-to)931-949
Number of pages19
JournalInternational Journal of Computer Vision
Volume128
Issue number4
DOIs
Publication statusPublished - 2020 Apr 1

All Science Journal Classification (ASJC) codes

  • Software
  • Computer Vision and Pattern Recognition
  • Artificial Intelligence

Fingerprint Dive into the research topics of 'VOSTR: Video Object Segmentation via Transferable Representations'. Together they form a unique fingerprint.

Cite this