A personalized summarization of video life-logs from an indoor multi-camera system using a fuzzy rule-based system with domain knowledge

Han Saem Park, Sung-Bae Cho

Research output: Contribution to journalArticle

15 Citations (Scopus)

Abstract

Information summarization and retrieval are significant research topics associated with recent advancements in sensor devices, data compression and storage techniques, and high-speed internet. As a result of these advances, it is possible for people to collect huge life-logs. Video is one of the most important life information sources. This paper describes a method of summarizing video life-logs in an office environment with a multi-camera system. Previously, multi-camera systems have been used to track moving objects or to cover a wide area. This paper focuses on capturing diverse views of each office event using a multi-camera system with several cameras observing the same area. The summarization process includes camera view selection and event sequence summarization. View selection produces a single event sequence from multiple event sequences by selecting an optimal view at each time, for which domain knowledge based on the elements of the office environment and rules from questionnaire surveys have been used. Summarization creates a summary sequence from whole sequences by using a fuzzy rule-based system to approximate human decision making. The user-entered degrees of interest in objects, persons, and events are used for a personalized summarization. We confirmed experimentally that the proposed method provides promising results.

Original languageEnglish
Pages (from-to)1124-1134
Number of pages11
JournalInformation Systems
Volume36
Issue number8
DOIs
Publication statusPublished - 2011 Dec 1

Fingerprint

Knowledge based systems
Fuzzy rules
Cameras
Data compression
Decision making
Internet
Sensors

All Science Journal Classification (ASJC) codes

  • Software
  • Information Systems
  • Hardware and Architecture

Cite this

@article{ddeb58dac347495d9345079b0bbc98fc,
title = "A personalized summarization of video life-logs from an indoor multi-camera system using a fuzzy rule-based system with domain knowledge",
abstract = "Information summarization and retrieval are significant research topics associated with recent advancements in sensor devices, data compression and storage techniques, and high-speed internet. As a result of these advances, it is possible for people to collect huge life-logs. Video is one of the most important life information sources. This paper describes a method of summarizing video life-logs in an office environment with a multi-camera system. Previously, multi-camera systems have been used to track moving objects or to cover a wide area. This paper focuses on capturing diverse views of each office event using a multi-camera system with several cameras observing the same area. The summarization process includes camera view selection and event sequence summarization. View selection produces a single event sequence from multiple event sequences by selecting an optimal view at each time, for which domain knowledge based on the elements of the office environment and rules from questionnaire surveys have been used. Summarization creates a summary sequence from whole sequences by using a fuzzy rule-based system to approximate human decision making. The user-entered degrees of interest in objects, persons, and events are used for a personalized summarization. We confirmed experimentally that the proposed method provides promising results.",
author = "Park, {Han Saem} and Sung-Bae Cho",
year = "2011",
month = "12",
day = "1",
doi = "10.1016/j.is.2011.04.005",
language = "English",
volume = "36",
pages = "1124--1134",
journal = "Information Systems",
issn = "0306-4379",
publisher = "Elsevier Limited",
number = "8",

}

A personalized summarization of video life-logs from an indoor multi-camera system using a fuzzy rule-based system with domain knowledge. / Park, Han Saem; Cho, Sung-Bae.

In: Information Systems, Vol. 36, No. 8, 01.12.2011, p. 1124-1134.

Research output: Contribution to journalArticle

TY - JOUR

T1 - A personalized summarization of video life-logs from an indoor multi-camera system using a fuzzy rule-based system with domain knowledge

AU - Park, Han Saem

AU - Cho, Sung-Bae

PY - 2011/12/1

Y1 - 2011/12/1

N2 - Information summarization and retrieval are significant research topics associated with recent advancements in sensor devices, data compression and storage techniques, and high-speed internet. As a result of these advances, it is possible for people to collect huge life-logs. Video is one of the most important life information sources. This paper describes a method of summarizing video life-logs in an office environment with a multi-camera system. Previously, multi-camera systems have been used to track moving objects or to cover a wide area. This paper focuses on capturing diverse views of each office event using a multi-camera system with several cameras observing the same area. The summarization process includes camera view selection and event sequence summarization. View selection produces a single event sequence from multiple event sequences by selecting an optimal view at each time, for which domain knowledge based on the elements of the office environment and rules from questionnaire surveys have been used. Summarization creates a summary sequence from whole sequences by using a fuzzy rule-based system to approximate human decision making. The user-entered degrees of interest in objects, persons, and events are used for a personalized summarization. We confirmed experimentally that the proposed method provides promising results.

AB - Information summarization and retrieval are significant research topics associated with recent advancements in sensor devices, data compression and storage techniques, and high-speed internet. As a result of these advances, it is possible for people to collect huge life-logs. Video is one of the most important life information sources. This paper describes a method of summarizing video life-logs in an office environment with a multi-camera system. Previously, multi-camera systems have been used to track moving objects or to cover a wide area. This paper focuses on capturing diverse views of each office event using a multi-camera system with several cameras observing the same area. The summarization process includes camera view selection and event sequence summarization. View selection produces a single event sequence from multiple event sequences by selecting an optimal view at each time, for which domain knowledge based on the elements of the office environment and rules from questionnaire surveys have been used. Summarization creates a summary sequence from whole sequences by using a fuzzy rule-based system to approximate human decision making. The user-entered degrees of interest in objects, persons, and events are used for a personalized summarization. We confirmed experimentally that the proposed method provides promising results.

UR - http://www.scopus.com/inward/record.url?scp=80051549174&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=80051549174&partnerID=8YFLogxK

U2 - 10.1016/j.is.2011.04.005

DO - 10.1016/j.is.2011.04.005

M3 - Article

AN - SCOPUS:80051549174

VL - 36

SP - 1124

EP - 1134

JO - Information Systems

JF - Information Systems

SN - 0306-4379

IS - 8

ER -