Real-time detection of nodding and head-shaking by directly detecting and tracking the "between-eyes"

Shinjiro Kawato, Jun Ohya

Research output: Chapter in Book/Report/Conference proceedingConference contribution

74 Citations (Scopus)

Abstract

Among head gestures, nodding and head-shaking are very common and used often. Thus the detection of such gestures is basic to a visual understanding of human responses. However it is difficult to detect them in real-time, because nodding and head-shaking are fairly small and fast head movements. We propose an approach for detecting nodding and head-shaking in real time from a single color video stream by directly detecting and tracking a point between the eyes, or what we call the "between-eyes". Along a circle of a certain radius centered at the "between-eyes", the pixel value has two cycles of bright parts (forehead and nose bridge) and dark parts (eyes and brows). The output of the proposed circle-frequency filter has a local maximum at these characteristic points. To distinguish the true "between-eyes" from similar characteristic points in other face parts, we do a confirmation with eye detection. Once the "between-eyes" is detected, a small area around it is copied as a template and the system enters the tracking mode.combining with the circle-frequency filtering and the template, the tracking is done not by searching around but by selecting candidates using the template; the template is then updated. Due to this special tracking algorithm, the system can track the "between-eyes" stably and accurately. It runs at 13 frames/s rate without special hardware. By analyzing the movement of the point, we can detect nodding and head-shaking. Some experimental results are shown.

Original languageEnglish
Title of host publicationProceedings - 4th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2000
PublisherIEEE Computer Society
Pages40-45
Number of pages6
ISBN (Print)0769505805, 9780769505800
DOIs
Publication statusPublished - 2000
Externally publishedYes
Event4th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2000 - Grenoble
Duration: 2000 Mar 282000 Mar 30

Other

Other4th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2000
CityGrenoble
Period00/3/2800/3/30

Fingerprint

Pixels
Color
Hardware

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition

Cite this

Kawato, S., & Ohya, J. (2000). Real-time detection of nodding and head-shaking by directly detecting and tracking the "between-eyes". In Proceedings - 4th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2000 (pp. 40-45). [840610] IEEE Computer Society. https://doi.org/10.1109/AFGR.2000.840610

Real-time detection of nodding and head-shaking by directly detecting and tracking the "between-eyes". / Kawato, Shinjiro; Ohya, Jun.

Proceedings - 4th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2000. IEEE Computer Society, 2000. p. 40-45 840610.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Kawato, S & Ohya, J 2000, Real-time detection of nodding and head-shaking by directly detecting and tracking the "between-eyes". in Proceedings - 4th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2000., 840610, IEEE Computer Society, pp. 40-45, 4th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2000, Grenoble, 00/3/28. https://doi.org/10.1109/AFGR.2000.840610
Kawato S, Ohya J. Real-time detection of nodding and head-shaking by directly detecting and tracking the "between-eyes". In Proceedings - 4th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2000. IEEE Computer Society. 2000. p. 40-45. 840610 https://doi.org/10.1109/AFGR.2000.840610
Kawato, Shinjiro ; Ohya, Jun. / Real-time detection of nodding and head-shaking by directly detecting and tracking the "between-eyes". Proceedings - 4th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2000. IEEE Computer Society, 2000. pp. 40-45
@inproceedings{bf8f6683dd474b638ff57c3bb82c5e1f,
title = "Real-time detection of nodding and head-shaking by directly detecting and tracking the {"}between-eyes{"}",
abstract = "Among head gestures, nodding and head-shaking are very common and used often. Thus the detection of such gestures is basic to a visual understanding of human responses. However it is difficult to detect them in real-time, because nodding and head-shaking are fairly small and fast head movements. We propose an approach for detecting nodding and head-shaking in real time from a single color video stream by directly detecting and tracking a point between the eyes, or what we call the {"}between-eyes{"}. Along a circle of a certain radius centered at the {"}between-eyes{"}, the pixel value has two cycles of bright parts (forehead and nose bridge) and dark parts (eyes and brows). The output of the proposed circle-frequency filter has a local maximum at these characteristic points. To distinguish the true {"}between-eyes{"} from similar characteristic points in other face parts, we do a confirmation with eye detection. Once the {"}between-eyes{"} is detected, a small area around it is copied as a template and the system enters the tracking mode.combining with the circle-frequency filtering and the template, the tracking is done not by searching around but by selecting candidates using the template; the template is then updated. Due to this special tracking algorithm, the system can track the {"}between-eyes{"} stably and accurately. It runs at 13 frames/s rate without special hardware. By analyzing the movement of the point, we can detect nodding and head-shaking. Some experimental results are shown.",
author = "Shinjiro Kawato and Jun Ohya",
year = "2000",
doi = "10.1109/AFGR.2000.840610",
language = "English",
isbn = "0769505805",
pages = "40--45",
booktitle = "Proceedings - 4th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2000",
publisher = "IEEE Computer Society",

}

TY - GEN

T1 - Real-time detection of nodding and head-shaking by directly detecting and tracking the "between-eyes"

AU - Kawato, Shinjiro

AU - Ohya, Jun

PY - 2000

Y1 - 2000

N2 - Among head gestures, nodding and head-shaking are very common and used often. Thus the detection of such gestures is basic to a visual understanding of human responses. However it is difficult to detect them in real-time, because nodding and head-shaking are fairly small and fast head movements. We propose an approach for detecting nodding and head-shaking in real time from a single color video stream by directly detecting and tracking a point between the eyes, or what we call the "between-eyes". Along a circle of a certain radius centered at the "between-eyes", the pixel value has two cycles of bright parts (forehead and nose bridge) and dark parts (eyes and brows). The output of the proposed circle-frequency filter has a local maximum at these characteristic points. To distinguish the true "between-eyes" from similar characteristic points in other face parts, we do a confirmation with eye detection. Once the "between-eyes" is detected, a small area around it is copied as a template and the system enters the tracking mode.combining with the circle-frequency filtering and the template, the tracking is done not by searching around but by selecting candidates using the template; the template is then updated. Due to this special tracking algorithm, the system can track the "between-eyes" stably and accurately. It runs at 13 frames/s rate without special hardware. By analyzing the movement of the point, we can detect nodding and head-shaking. Some experimental results are shown.

AB - Among head gestures, nodding and head-shaking are very common and used often. Thus the detection of such gestures is basic to a visual understanding of human responses. However it is difficult to detect them in real-time, because nodding and head-shaking are fairly small and fast head movements. We propose an approach for detecting nodding and head-shaking in real time from a single color video stream by directly detecting and tracking a point between the eyes, or what we call the "between-eyes". Along a circle of a certain radius centered at the "between-eyes", the pixel value has two cycles of bright parts (forehead and nose bridge) and dark parts (eyes and brows). The output of the proposed circle-frequency filter has a local maximum at these characteristic points. To distinguish the true "between-eyes" from similar characteristic points in other face parts, we do a confirmation with eye detection. Once the "between-eyes" is detected, a small area around it is copied as a template and the system enters the tracking mode.combining with the circle-frequency filtering and the template, the tracking is done not by searching around but by selecting candidates using the template; the template is then updated. Due to this special tracking algorithm, the system can track the "between-eyes" stably and accurately. It runs at 13 frames/s rate without special hardware. By analyzing the movement of the point, we can detect nodding and head-shaking. Some experimental results are shown.

UR - http://www.scopus.com/inward/record.url?scp=34948873627&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=34948873627&partnerID=8YFLogxK

U2 - 10.1109/AFGR.2000.840610

DO - 10.1109/AFGR.2000.840610

M3 - Conference contribution

AN - SCOPUS:34948873627

SN - 0769505805

SN - 9780769505800

SP - 40

EP - 45

BT - Proceedings - 4th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2000

PB - IEEE Computer Society

ER -