Future-frame prediction for fast-moving objects with motion blur

Dohae Lee, Young Jin Oh, In Kwon Lee

Research output: Contribution to journalArticlepeer-review

Abstract

We propose a deep neural network model that recognizes the position and velocity of a fast-moving object in a video sequence and predicts the object’s future motion. When filming a fast-moving subject using a regular camera rather than a super-high-speed camera, there is often severe motion blur, making it difficult to recognize the exact location and speed of the object in the video. Additionally, because the fast moving object usually moves rapidly out of the camera’s field of view, the number of captured frames used as input for future-motion predictions should be minimized. Our model can capture a short video sequence of two frames with a high-speed moving object as input, use motion blur as additional information to recognize the position and velocity of the object, and predict the video frame containing the future motion of the object. Experiments show that our model has significantly better performance than existing future-frame prediction models in determining the future position and velocity of an object in two physical scenarios where a fast-moving two-dimensional object appears.

Original languageEnglish
Article number4394
Pages (from-to)1-19
Number of pages19
JournalSensors (Switzerland)
Volume20
Issue number16
DOIs
Publication statusPublished - 2020 Aug 2

Bibliographical note

Funding Information:
Funding: This research was supported by the MSIT(Ministry of Science and ICT), Korea, under the ITRC(Information Technology Research Center) support program(IITP-2020-2018-0-01419) supervised by the IITP(Institute for Information and Communications Technology Planning and Evaluation) and the National Research Foundation of Korea(NRF) grant funded by the Korea government(MSIT). (No. NRF-2020R1A2C2014622)

Funding Information:
This research was supported by the MSIT (Ministry of Science and ICT), Korea, under the ITRC (Information Technology Research Center) support program(IITP-2020-2018-0-01419) supervised by the IITP(Institute for Information and Communications Technology Planning and Evaluation) and the National Research Foundation of Korea(NRF) grant funded by the Korea government(MSIT). (No. NRF-2020R1A2C2014622).

Publisher Copyright:
© 2020 by the authors. Licensee MDPI, Basel, Switzerland.

All Science Journal Classification (ASJC) codes

  • Analytical Chemistry
  • Information Systems
  • Atomic and Molecular Physics, and Optics
  • Biochemistry
  • Instrumentation
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Future-frame prediction for fast-moving objects with motion blur'. Together they form a unique fingerprint.

Cite this