Efficient depth enhancement using a combination of color and depth information

Kyungjae Lee, Yuseok Ban, Sang Youn Lee

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

Studies on depth images containing three-dimensional information have been performed for many practical applications. However, the depth images acquired from depth sensors have inherent problems, such as missing values and noisy boundaries. These problems significantly affect the performance of applications that use a depth image as their input. This paper describes a depth enhancement algorithm based on a combination of color and depth information. To fill depth holes and recover object shapes, asynchronous cellular automata with neighborhood distance maps are used. Image segmentation and a weighted linear combination of spatial filtering algorithms are applied to extract object regions and fill disocclusion in the object regions. Experimental results on both real-world and public datasets show that the proposed method enhances the quality of the depth image with low computational complexity, outperforming conventional methods on a number of metrics. Furthermore, to verify the performance of the proposed method, we present stereoscopic images generated by the enhanced depth image to illustrate the improvement in quality.

Original languageEnglish
Article number1544
JournalSensors (Switzerland)
Volume17
Issue number7
DOIs
Publication statusPublished - 2017 Jul 1

Fingerprint

Color
color
augmentation
Cellular automata
Image segmentation
Computational complexity
Three-Dimensional Imaging
Quality Improvement
Sensors
spatial filtering
cellular automata
sensors
Datasets

All Science Journal Classification (ASJC) codes

  • Analytical Chemistry
  • Atomic and Molecular Physics, and Optics
  • Biochemistry
  • Instrumentation
  • Electrical and Electronic Engineering

Cite this

@article{38f15c9ed7b04a11adfa9af63e9d86f4,
title = "Efficient depth enhancement using a combination of color and depth information",
abstract = "Studies on depth images containing three-dimensional information have been performed for many practical applications. However, the depth images acquired from depth sensors have inherent problems, such as missing values and noisy boundaries. These problems significantly affect the performance of applications that use a depth image as their input. This paper describes a depth enhancement algorithm based on a combination of color and depth information. To fill depth holes and recover object shapes, asynchronous cellular automata with neighborhood distance maps are used. Image segmentation and a weighted linear combination of spatial filtering algorithms are applied to extract object regions and fill disocclusion in the object regions. Experimental results on both real-world and public datasets show that the proposed method enhances the quality of the depth image with low computational complexity, outperforming conventional methods on a number of metrics. Furthermore, to verify the performance of the proposed method, we present stereoscopic images generated by the enhanced depth image to illustrate the improvement in quality.",
author = "Kyungjae Lee and Yuseok Ban and Lee, {Sang Youn}",
year = "2017",
month = "7",
day = "1",
doi = "10.3390/s17071544",
language = "English",
volume = "17",
journal = "Sensors",
issn = "1424-3210",
publisher = "Multidisciplinary Digital Publishing Institute (MDPI)",
number = "7",

}

Efficient depth enhancement using a combination of color and depth information. / Lee, Kyungjae; Ban, Yuseok; Lee, Sang Youn.

In: Sensors (Switzerland), Vol. 17, No. 7, 1544, 01.07.2017.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Efficient depth enhancement using a combination of color and depth information

AU - Lee, Kyungjae

AU - Ban, Yuseok

AU - Lee, Sang Youn

PY - 2017/7/1

Y1 - 2017/7/1

N2 - Studies on depth images containing three-dimensional information have been performed for many practical applications. However, the depth images acquired from depth sensors have inherent problems, such as missing values and noisy boundaries. These problems significantly affect the performance of applications that use a depth image as their input. This paper describes a depth enhancement algorithm based on a combination of color and depth information. To fill depth holes and recover object shapes, asynchronous cellular automata with neighborhood distance maps are used. Image segmentation and a weighted linear combination of spatial filtering algorithms are applied to extract object regions and fill disocclusion in the object regions. Experimental results on both real-world and public datasets show that the proposed method enhances the quality of the depth image with low computational complexity, outperforming conventional methods on a number of metrics. Furthermore, to verify the performance of the proposed method, we present stereoscopic images generated by the enhanced depth image to illustrate the improvement in quality.

AB - Studies on depth images containing three-dimensional information have been performed for many practical applications. However, the depth images acquired from depth sensors have inherent problems, such as missing values and noisy boundaries. These problems significantly affect the performance of applications that use a depth image as their input. This paper describes a depth enhancement algorithm based on a combination of color and depth information. To fill depth holes and recover object shapes, asynchronous cellular automata with neighborhood distance maps are used. Image segmentation and a weighted linear combination of spatial filtering algorithms are applied to extract object regions and fill disocclusion in the object regions. Experimental results on both real-world and public datasets show that the proposed method enhances the quality of the depth image with low computational complexity, outperforming conventional methods on a number of metrics. Furthermore, to verify the performance of the proposed method, we present stereoscopic images generated by the enhanced depth image to illustrate the improvement in quality.

UR - http://www.scopus.com/inward/record.url?scp=85021675621&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85021675621&partnerID=8YFLogxK

U2 - 10.3390/s17071544

DO - 10.3390/s17071544

M3 - Article

AN - SCOPUS:85021675621

VL - 17

JO - Sensors

JF - Sensors

SN - 1424-3210

IS - 7

M1 - 1544

ER -