JOTS: Joint Online Tracking and Segmentation

Longyin Wen, Dawei Du, Zhen Lei, Stan Z. Li, Ming Hsuan Yang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

67 Citations (Scopus)

Abstract

We present a novel Joint Online Tracking and Segmentation (JOTS) algorithm which integrates the multi-part tracking and segmentation into a unified energy optimization framework to handle the video segmentation task. The multi-part segmentation is posed as a pixel-level label assignment task with regularization according to the estimated part models, and tracking is formulated as estimating the part models based on the pixel labels, which in turn is used to refine the model. The multi-part tracking and segmentation are carried out iteratively to minimize the proposed objective function by a RANSAC-style approach. Extensive experiments on the SegTrack and SegTrack v2 databases demonstrate that the proposed algorithm performs favorably against the state-of-the-art methods.

Original languageEnglish
Title of host publicationIEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015
PublisherIEEE Computer Society
Pages2226-2234
Number of pages9
ISBN (Electronic)9781467369640
DOIs
Publication statusPublished - 2015 Oct 14
EventIEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015 - Boston, United States
Duration: 2015 Jun 72015 Jun 12

Publication series

NameProceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
Volume07-12-June-2015
ISSN (Print)1063-6919

Other

OtherIEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015
CountryUnited States
CityBoston
Period15/6/715/6/12

Fingerprint

Labels
Pixels
Experiments

All Science Journal Classification (ASJC) codes

  • Software
  • Computer Vision and Pattern Recognition

Cite this

Wen, L., Du, D., Lei, Z., Li, S. Z., & Yang, M. H. (2015). JOTS: Joint Online Tracking and Segmentation. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015 (pp. 2226-2234). [7298835] (Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition; Vol. 07-12-June-2015). IEEE Computer Society. https://doi.org/10.1109/CVPR.2015.7298835
Wen, Longyin ; Du, Dawei ; Lei, Zhen ; Li, Stan Z. ; Yang, Ming Hsuan. / JOTS : Joint Online Tracking and Segmentation. IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015. IEEE Computer Society, 2015. pp. 2226-2234 (Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition).
@inproceedings{bf849a19ecab4485beccbe7f5b266c55,
title = "JOTS: Joint Online Tracking and Segmentation",
abstract = "We present a novel Joint Online Tracking and Segmentation (JOTS) algorithm which integrates the multi-part tracking and segmentation into a unified energy optimization framework to handle the video segmentation task. The multi-part segmentation is posed as a pixel-level label assignment task with regularization according to the estimated part models, and tracking is formulated as estimating the part models based on the pixel labels, which in turn is used to refine the model. The multi-part tracking and segmentation are carried out iteratively to minimize the proposed objective function by a RANSAC-style approach. Extensive experiments on the SegTrack and SegTrack v2 databases demonstrate that the proposed algorithm performs favorably against the state-of-the-art methods.",
author = "Longyin Wen and Dawei Du and Zhen Lei and Li, {Stan Z.} and Yang, {Ming Hsuan}",
year = "2015",
month = "10",
day = "14",
doi = "10.1109/CVPR.2015.7298835",
language = "English",
series = "Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition",
publisher = "IEEE Computer Society",
pages = "2226--2234",
booktitle = "IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015",
address = "United States",

}

Wen, L, Du, D, Lei, Z, Li, SZ & Yang, MH 2015, JOTS: Joint Online Tracking and Segmentation. in IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015., 7298835, Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 07-12-June-2015, IEEE Computer Society, pp. 2226-2234, IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015, Boston, United States, 15/6/7. https://doi.org/10.1109/CVPR.2015.7298835

JOTS : Joint Online Tracking and Segmentation. / Wen, Longyin; Du, Dawei; Lei, Zhen; Li, Stan Z.; Yang, Ming Hsuan.

IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015. IEEE Computer Society, 2015. p. 2226-2234 7298835 (Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition; Vol. 07-12-June-2015).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - JOTS

T2 - Joint Online Tracking and Segmentation

AU - Wen, Longyin

AU - Du, Dawei

AU - Lei, Zhen

AU - Li, Stan Z.

AU - Yang, Ming Hsuan

PY - 2015/10/14

Y1 - 2015/10/14

N2 - We present a novel Joint Online Tracking and Segmentation (JOTS) algorithm which integrates the multi-part tracking and segmentation into a unified energy optimization framework to handle the video segmentation task. The multi-part segmentation is posed as a pixel-level label assignment task with regularization according to the estimated part models, and tracking is formulated as estimating the part models based on the pixel labels, which in turn is used to refine the model. The multi-part tracking and segmentation are carried out iteratively to minimize the proposed objective function by a RANSAC-style approach. Extensive experiments on the SegTrack and SegTrack v2 databases demonstrate that the proposed algorithm performs favorably against the state-of-the-art methods.

AB - We present a novel Joint Online Tracking and Segmentation (JOTS) algorithm which integrates the multi-part tracking and segmentation into a unified energy optimization framework to handle the video segmentation task. The multi-part segmentation is posed as a pixel-level label assignment task with regularization according to the estimated part models, and tracking is formulated as estimating the part models based on the pixel labels, which in turn is used to refine the model. The multi-part tracking and segmentation are carried out iteratively to minimize the proposed objective function by a RANSAC-style approach. Extensive experiments on the SegTrack and SegTrack v2 databases demonstrate that the proposed algorithm performs favorably against the state-of-the-art methods.

UR - http://www.scopus.com/inward/record.url?scp=84959236471&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84959236471&partnerID=8YFLogxK

U2 - 10.1109/CVPR.2015.7298835

DO - 10.1109/CVPR.2015.7298835

M3 - Conference contribution

AN - SCOPUS:84959236471

T3 - Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

SP - 2226

EP - 2234

BT - IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015

PB - IEEE Computer Society

ER -

Wen L, Du D, Lei Z, Li SZ, Yang MH. JOTS: Joint Online Tracking and Segmentation. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015. IEEE Computer Society. 2015. p. 2226-2234. 7298835. (Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition). https://doi.org/10.1109/CVPR.2015.7298835