Real-time detection of nodding and head-shaking by directly detecting and tracking the "between-eyes"

Shinjiro Kawato, Jun Ohya

Research output: Chapter in Book/Report/Conference proceedingConference contribution

78 Citations (Scopus)

Abstract

Among head gestures, nodding and head-shaking are very common and used often. Thus the detection of such gestures is basic to a visual understanding of human responses. However it is difficult to detect them in real-time, because nodding and head-shaking are fairly small and fast head movements. We propose an approach for detecting nodding and head-shaking in real time from a single color video stream by directly detecting and tracking a point between the eyes, or what we call the "between-eyes". Along a circle of a certain radius centered at the "between-eyes", the pixel value has two cycles of bright parts (forehead and nose bridge) and dark parts (eyes and brows). The output of the proposed circle-frequency filter has a local maximum at these characteristic points. To distinguish the true "between-eyes" from similar characteristic points in other face parts, we do a confirmation with eye detection. Once the "between-eyes" is detected, a small area around it is copied as a template and the system enters the tracking mode.combining with the circle-frequency filtering and the template, the tracking is done not by searching around but by selecting candidates using the template; the template is then updated. Due to this special tracking algorithm, the system can track the "between-eyes" stably and accurately. It runs at 13 frames/s rate without special hardware. By analyzing the movement of the point, we can detect nodding and head-shaking. Some experimental results are shown.

Original languageEnglish
Title of host publicationProceedings - 4th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2000
PublisherIEEE Computer Society
Pages40-45
Number of pages6
ISBN (Print)0769505805, 9780769505800
DOIs
Publication statusPublished - 2000 Jan 1
Externally publishedYes
Event4th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2000 - Grenoble, France
Duration: 2000 Mar 282000 Mar 30

Publication series

NameProceedings - 4th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2000

Conference

Conference4th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2000
CountryFrance
CityGrenoble
Period00/3/2800/3/30

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition

Fingerprint Dive into the research topics of 'Real-time detection of nodding and head-shaking by directly detecting and tracking the "between-eyes"'. Together they form a unique fingerprint.

  • Cite this

    Kawato, S., & Ohya, J. (2000). Real-time detection of nodding and head-shaking by directly detecting and tracking the "between-eyes". In Proceedings - 4th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2000 (pp. 40-45). [840610] (Proceedings - 4th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2000). IEEE Computer Society. https://doi.org/10.1109/AFGR.2000.840610