Real-time detection of nodding and head-shaking by directly detecting and tracking the "between-eyes"

Shinjiro Kawato, Jun Ohya

Research output: Chapter in Book/Report/Conference proceedingConference contribution

75 Citations (Scopus)

Abstract

Among head gestures, nodding and head-shaking are very common and used often. Thus the detection of such gestures is basic to a visual understanding of human responses. However it is difficult to detect them in real-time, because nodding and head-shaking are fairly small and fast head movements. We propose an approach for detecting nodding and head-shaking in real time from a single color video stream by directly detecting and tracking a point between the eyes, or what we call the "between-eyes". Along a circle of a certain radius centered at the "between-eyes", the pixel value has two cycles of bright parts (forehead and nose bridge) and dark parts (eyes and brows). The output of the proposed circle-frequency filter has a local maximum at these characteristic points. To distinguish the true "between-eyes" from similar characteristic points in other face parts, we do a confirmation with eye detection. Once the "between-eyes" is detected, a small area around it is copied as a template and the system enters the tracking mode.combining with the circle-frequency filtering and the template, the tracking is done not by searching around but by selecting candidates using the template; the template is then updated. Due to this special tracking algorithm, the system can track the "between-eyes" stably and accurately. It runs at 13 frames/s rate without special hardware. By analyzing the movement of the point, we can detect nodding and head-shaking. Some experimental results are shown.

Original languageEnglish
Title of host publicationProceedings - 4th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2000
PublisherIEEE Computer Society
Pages40-45
Number of pages6
ISBN (Print)0769505805, 9780769505800
DOIs
Publication statusPublished - 2000
Externally publishedYes
Event4th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2000 - Grenoble
Duration: 2000 Mar 282000 Mar 30

Other

Other4th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2000
CityGrenoble
Period00/3/2800/3/30

    Fingerprint

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition

Cite this

Kawato, S., & Ohya, J. (2000). Real-time detection of nodding and head-shaking by directly detecting and tracking the "between-eyes". In Proceedings - 4th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2000 (pp. 40-45). [840610] IEEE Computer Society. https://doi.org/10.1109/AFGR.2000.840610