Stereo camera based virtual cane system with identifiable distance tactile feedback for the blind

Donghun Kim, Kwangtaek Kim, Sangyoun Lee

Research output: Contribution to journalArticle

18 Citations (Scopus)

Abstract

In this paper, we propose a new haptic-assisted virtual cane system operated by a simple finger pointing gesture. The system is developed by two stages: development of visual information delivery assistant (VIDA) with a stereo camera and adding a tactile feedback interface with dual actuators for guidance and distance feedbacks. In the first stage, user's pointing finger is automatically detected using color and disparity data from stereo images and then a 3D pointing direction of the finger is estimated with its geometric and textural features. Finally, any object within the estimated pointing trajectory in 3D space is detected and the distance is then estimated in real time. For the second stage, identifiable tactile signals are designed through a series of identification experiments, and an identifiable tactile feedback interface is developed and integrated into the VIDA system. Our approach differs in that navigation guidance is provided by a simple finger pointing gesture and tactile distance feedbacks are perfectly identifiable to the blind.

Original languageEnglish
Pages (from-to)10412-10431
Number of pages20
JournalSensors (Switzerland)
Volume14
Issue number6
DOIs
Publication statusPublished - 2014 Jun 13

Fingerprint

User-Computer Interface
Canes
Touch
Fingers
Cameras
cameras
Feedback
Gestures
delivery
navigation
Navigation
Actuators
Color
actuators
Trajectories
trajectories
color
Experiments

All Science Journal Classification (ASJC) codes

  • Analytical Chemistry
  • Biochemistry
  • Atomic and Molecular Physics, and Optics
  • Instrumentation
  • Electrical and Electronic Engineering

Cite this

@article{b201e7b4ab9d443aba3b9566ec4fa0e4,
title = "Stereo camera based virtual cane system with identifiable distance tactile feedback for the blind",
abstract = "In this paper, we propose a new haptic-assisted virtual cane system operated by a simple finger pointing gesture. The system is developed by two stages: development of visual information delivery assistant (VIDA) with a stereo camera and adding a tactile feedback interface with dual actuators for guidance and distance feedbacks. In the first stage, user's pointing finger is automatically detected using color and disparity data from stereo images and then a 3D pointing direction of the finger is estimated with its geometric and textural features. Finally, any object within the estimated pointing trajectory in 3D space is detected and the distance is then estimated in real time. For the second stage, identifiable tactile signals are designed through a series of identification experiments, and an identifiable tactile feedback interface is developed and integrated into the VIDA system. Our approach differs in that navigation guidance is provided by a simple finger pointing gesture and tactile distance feedbacks are perfectly identifiable to the blind.",
author = "Donghun Kim and Kwangtaek Kim and Sangyoun Lee",
year = "2014",
month = "6",
day = "13",
doi = "10.3390/s140610412",
language = "English",
volume = "14",
pages = "10412--10431",
journal = "Sensors",
issn = "1424-3210",
publisher = "Multidisciplinary Digital Publishing Institute (MDPI)",
number = "6",

}

Stereo camera based virtual cane system with identifiable distance tactile feedback for the blind. / Kim, Donghun; Kim, Kwangtaek; Lee, Sangyoun.

In: Sensors (Switzerland), Vol. 14, No. 6, 13.06.2014, p. 10412-10431.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Stereo camera based virtual cane system with identifiable distance tactile feedback for the blind

AU - Kim, Donghun

AU - Kim, Kwangtaek

AU - Lee, Sangyoun

PY - 2014/6/13

Y1 - 2014/6/13

N2 - In this paper, we propose a new haptic-assisted virtual cane system operated by a simple finger pointing gesture. The system is developed by two stages: development of visual information delivery assistant (VIDA) with a stereo camera and adding a tactile feedback interface with dual actuators for guidance and distance feedbacks. In the first stage, user's pointing finger is automatically detected using color and disparity data from stereo images and then a 3D pointing direction of the finger is estimated with its geometric and textural features. Finally, any object within the estimated pointing trajectory in 3D space is detected and the distance is then estimated in real time. For the second stage, identifiable tactile signals are designed through a series of identification experiments, and an identifiable tactile feedback interface is developed and integrated into the VIDA system. Our approach differs in that navigation guidance is provided by a simple finger pointing gesture and tactile distance feedbacks are perfectly identifiable to the blind.

AB - In this paper, we propose a new haptic-assisted virtual cane system operated by a simple finger pointing gesture. The system is developed by two stages: development of visual information delivery assistant (VIDA) with a stereo camera and adding a tactile feedback interface with dual actuators for guidance and distance feedbacks. In the first stage, user's pointing finger is automatically detected using color and disparity data from stereo images and then a 3D pointing direction of the finger is estimated with its geometric and textural features. Finally, any object within the estimated pointing trajectory in 3D space is detected and the distance is then estimated in real time. For the second stage, identifiable tactile signals are designed through a series of identification experiments, and an identifiable tactile feedback interface is developed and integrated into the VIDA system. Our approach differs in that navigation guidance is provided by a simple finger pointing gesture and tactile distance feedbacks are perfectly identifiable to the blind.

UR - http://www.scopus.com/inward/record.url?scp=84903544069&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84903544069&partnerID=8YFLogxK

U2 - 10.3390/s140610412

DO - 10.3390/s140610412

M3 - Article

C2 - 24932864

AN - SCOPUS:84903544069

VL - 14

SP - 10412

EP - 10431

JO - Sensors

JF - Sensors

SN - 1424-3210

IS - 6

ER -