Intelligent process control via gaze detection technology

Jaihie Kim, Kang Ryoung Park, Jeong Jun Lee, Steven R. Leclair

Research output: Contribution to journalArticle

30 Citations (Scopus)

Abstract

Gaze detection is to locate the position on a monitor screen where a user is looking. In our work, we implement it with a computer vision system setting a camera above a monitor, and a user moves (rotates and/or translates) his face to gaze at a different position on the monitor. In our case, the user is requested to keep the pupils of his/her eyes fixed when he/she gazes at a different position on the monitor screen; though we are working on to relax this restriction. Till now, we have tried different methods and among them, the proposed Two Neural Networks method shows the best results. For application of the gaze detection techniques to the user-interface of a control program, we supplement two additional techniques. One is to drag a mouse cursor by moving his/her face after initially placing the cursor by gazing, and another is to click the cursor by winking one eye. These are applied to user-interface of a process control program in three different ways. Firstly, even when both hands are busy in doing a work, the user can still control the monitor screen by gazing, dragging and winking. Secondly, if the user is absent and not in front of the monitor when important states occur, then the system can record and replay them later when the user returns. Finally, as the system knows where the user is looking, if an emergency occurs at a different point from where he/she is looking, then the system can display a warning signal. This paper also includes subjective and objective experimental results obtained from the tests by applying the underlined techniques to a process control for chemical vapor decomposition.

Original languageEnglish
Pages (from-to)577-587
Number of pages11
JournalEngineering Applications of Artificial Intelligence
Volume13
Issue number5
DOIs
Publication statusPublished - 2000 Jan 1

Fingerprint

User interfaces
Process control
Computer vision
Drag
Cameras
Vapors
Neural networks
Decomposition

All Science Journal Classification (ASJC) codes

  • Control and Systems Engineering
  • Artificial Intelligence
  • Electrical and Electronic Engineering

Cite this

Kim, Jaihie ; Park, Kang Ryoung ; Lee, Jeong Jun ; Leclair, Steven R. / Intelligent process control via gaze detection technology. In: Engineering Applications of Artificial Intelligence. 2000 ; Vol. 13, No. 5. pp. 577-587.
@article{1dc1ab18eddf473690bdf46e6255f994,
title = "Intelligent process control via gaze detection technology",
abstract = "Gaze detection is to locate the position on a monitor screen where a user is looking. In our work, we implement it with a computer vision system setting a camera above a monitor, and a user moves (rotates and/or translates) his face to gaze at a different position on the monitor. In our case, the user is requested to keep the pupils of his/her eyes fixed when he/she gazes at a different position on the monitor screen; though we are working on to relax this restriction. Till now, we have tried different methods and among them, the proposed Two Neural Networks method shows the best results. For application of the gaze detection techniques to the user-interface of a control program, we supplement two additional techniques. One is to drag a mouse cursor by moving his/her face after initially placing the cursor by gazing, and another is to click the cursor by winking one eye. These are applied to user-interface of a process control program in three different ways. Firstly, even when both hands are busy in doing a work, the user can still control the monitor screen by gazing, dragging and winking. Secondly, if the user is absent and not in front of the monitor when important states occur, then the system can record and replay them later when the user returns. Finally, as the system knows where the user is looking, if an emergency occurs at a different point from where he/she is looking, then the system can display a warning signal. This paper also includes subjective and objective experimental results obtained from the tests by applying the underlined techniques to a process control for chemical vapor decomposition.",
author = "Jaihie Kim and Park, {Kang Ryoung} and Lee, {Jeong Jun} and Leclair, {Steven R.}",
year = "2000",
month = "1",
day = "1",
doi = "10.1016/S0952-1976(00)00037-3",
language = "English",
volume = "13",
pages = "577--587",
journal = "Engineering Applications of Artificial Intelligence",
issn = "0952-1976",
publisher = "Elsevier Limited",
number = "5",

}

Intelligent process control via gaze detection technology. / Kim, Jaihie; Park, Kang Ryoung; Lee, Jeong Jun; Leclair, Steven R.

In: Engineering Applications of Artificial Intelligence, Vol. 13, No. 5, 01.01.2000, p. 577-587.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Intelligent process control via gaze detection technology

AU - Kim, Jaihie

AU - Park, Kang Ryoung

AU - Lee, Jeong Jun

AU - Leclair, Steven R.

PY - 2000/1/1

Y1 - 2000/1/1

N2 - Gaze detection is to locate the position on a monitor screen where a user is looking. In our work, we implement it with a computer vision system setting a camera above a monitor, and a user moves (rotates and/or translates) his face to gaze at a different position on the monitor. In our case, the user is requested to keep the pupils of his/her eyes fixed when he/she gazes at a different position on the monitor screen; though we are working on to relax this restriction. Till now, we have tried different methods and among them, the proposed Two Neural Networks method shows the best results. For application of the gaze detection techniques to the user-interface of a control program, we supplement two additional techniques. One is to drag a mouse cursor by moving his/her face after initially placing the cursor by gazing, and another is to click the cursor by winking one eye. These are applied to user-interface of a process control program in three different ways. Firstly, even when both hands are busy in doing a work, the user can still control the monitor screen by gazing, dragging and winking. Secondly, if the user is absent and not in front of the monitor when important states occur, then the system can record and replay them later when the user returns. Finally, as the system knows where the user is looking, if an emergency occurs at a different point from where he/she is looking, then the system can display a warning signal. This paper also includes subjective and objective experimental results obtained from the tests by applying the underlined techniques to a process control for chemical vapor decomposition.

AB - Gaze detection is to locate the position on a monitor screen where a user is looking. In our work, we implement it with a computer vision system setting a camera above a monitor, and a user moves (rotates and/or translates) his face to gaze at a different position on the monitor. In our case, the user is requested to keep the pupils of his/her eyes fixed when he/she gazes at a different position on the monitor screen; though we are working on to relax this restriction. Till now, we have tried different methods and among them, the proposed Two Neural Networks method shows the best results. For application of the gaze detection techniques to the user-interface of a control program, we supplement two additional techniques. One is to drag a mouse cursor by moving his/her face after initially placing the cursor by gazing, and another is to click the cursor by winking one eye. These are applied to user-interface of a process control program in three different ways. Firstly, even when both hands are busy in doing a work, the user can still control the monitor screen by gazing, dragging and winking. Secondly, if the user is absent and not in front of the monitor when important states occur, then the system can record and replay them later when the user returns. Finally, as the system knows where the user is looking, if an emergency occurs at a different point from where he/she is looking, then the system can display a warning signal. This paper also includes subjective and objective experimental results obtained from the tests by applying the underlined techniques to a process control for chemical vapor decomposition.

UR - http://www.scopus.com/inward/record.url?scp=0034298995&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0034298995&partnerID=8YFLogxK

U2 - 10.1016/S0952-1976(00)00037-3

DO - 10.1016/S0952-1976(00)00037-3

M3 - Article

AN - SCOPUS:0034298995

VL - 13

SP - 577

EP - 587

JO - Engineering Applications of Artificial Intelligence

JF - Engineering Applications of Artificial Intelligence

SN - 0952-1976

IS - 5

ER -