Graph Regularization Network with Semantic Affinity for Weakly-Supervised Temporal Action Localization

Jungin Park, Jiyoung Lee, Sangryul Jeon, Seungryong Kim, Kwanghoon Sohn

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper presents a novel deep architecture for weakly-supervised temporal action localization that not only generates segment-level action responses but also propagates segment-level responses to the neighborhood in a form of graph Laplacian regularization. Specifically, our approach consists of two sub-modules; a class activation module to estimate the action score map over time through the action classifiers, and a graph regularization module to refine the estimated action score map by solving a quadratic programming problem with the predicted segment-level semantic affinities. Since these two modules are integrated with fully differentiable layers, the proposed networks can be jointly trained in an end-to-end manner. Experimental results on Thumos14 and ActivityNet1.2 demonstrate that the proposed method provides outstanding performances in weakly-supervised temporal action localization.

Original languageEnglish
Title of host publication2019 IEEE International Conference on Image Processing, ICIP 2019 - Proceedings
PublisherIEEE Computer Society
Pages3701-3705
Number of pages5
ISBN (Electronic)9781538662496
DOIs
Publication statusPublished - 2019 Sep
Event26th IEEE International Conference on Image Processing, ICIP 2019 - Taipei, Taiwan, Province of China
Duration: 2019 Sep 222019 Sep 25

Publication series

NameProceedings - International Conference on Image Processing, ICIP
Volume2019-September
ISSN (Print)1522-4880

Conference

Conference26th IEEE International Conference on Image Processing, ICIP 2019
CountryTaiwan, Province of China
CityTaipei
Period19/9/2219/9/25

All Science Journal Classification (ASJC) codes

  • Software
  • Computer Vision and Pattern Recognition
  • Signal Processing

Fingerprint Dive into the research topics of 'Graph Regularization Network with Semantic Affinity for Weakly-Supervised Temporal Action Localization'. Together they form a unique fingerprint.

  • Cite this

    Park, J., Lee, J., Jeon, S., Kim, S., & Sohn, K. (2019). Graph Regularization Network with Semantic Affinity for Weakly-Supervised Temporal Action Localization. In 2019 IEEE International Conference on Image Processing, ICIP 2019 - Proceedings (pp. 3701-3705). [8803589] (Proceedings - International Conference on Image Processing, ICIP; Vol. 2019-September). IEEE Computer Society. https://doi.org/10.1109/ICIP.2019.8803589