This paper describes a parallel computing system and a software algorithm for real-time interaction between a human user and a synthesized, humanlike, moving image. The realistic humanlike agent on a monitor can recognize the palm position and finger motion (finger sign) of the user. She/he then tracks and gazes at the hand position to change her/his facial expression in response to the finger sign in real time. This visual software agent (VSA) is expected to play an important role in building an advanced human interface. We regard this type of interactive agent as a visual software robot. To achieve real-time image recognition and image synthesis, we have developed a parallel visual computer system the transputer network with visual interface to transputers (TN-VIT). The imagesynthesis speed of the TN-VIT is about 24 frames/s, including finger-sign recognition. Some samples of synthesized images and experimental results are shown.
ASJC Scopus subject areas
- コンピュータ ビジョンおよびパターン認識